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Optimal  Control  of  Systems  With  Uncertainty 


I.  Introduction 

The  research  being  performed  under  AFOSR  Grant  76-2923  is  concerned  with 
optimally  controlling  a system  to  a specified  target  when  disturbances  or 
uncertainties  enter  the  system.  Two  general  problems  in  this  area  are  being 


investigated.  One  problem  is  that  of  determining  if  there  exists  a control 
that  assures  that  the  system  reaches  a sepcified  target  set  for  all  possible 
disturbances.  If  such  a control  exists,  then  the  next  problem  is  to  determine 
a control  which  guarantees  that  the  target  is  reached  and  is  also  optimal 
in  the  sense  of  minimizing  a specified  measure  of  the  system's  performance. 

Our  research  effort  has  been  directed  toward  obtaining  methods  for  answering 
the  questions  raised  by  these  problems  and  thereby  aiding  in  the  design  of 
controllers  for  uncertain  systems. 


II.  Results  Obtained 

The  problem  of  controlling  a system  to  a target  belongs  to  the  general 
area  of  controllability  problems.  Most  results  in  this  area  have  dealt  with 
linear,  constant  coefficient  systems  without  control  constraints.  But  in  many 
realistic  situations  there  are  magnitude  constraints  on  the  control  values  and 
the  linear  system  has  time-varying  coefficients.  We  have  obtained 
necessary  and  sufficient  conditions  for  the  existence  of  a control  which 
steers  the  system  to  the  origin  when  there  are  magnitude  constraints  on  the 
control  values  and  when  the  linear  system  is  a time  varying  one.  In  addition, 
we  have  also  devised  a technique  for  determining  a control  which  drives  from 
system  from  a given  initial  state  to  the  origin.  The  complete  details  of 
this  research  are  included  as  Appendices  A,  B and  C.  The  paper  in  Appendix  A 


has  been  submitted  to  the  S.I.A.M.  Journal  on  Control  and  Optimization  while 
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the  material  in  Appendices  B and  C will  be  presented  at  the  1978  Allerton 
Conference  on  Communication,  Control  and  Computing  and  the  17th  IEEE  Conference 
on  Decision  and  Control,  respectively. 

We  have  previously  reported  on  the  sufficient  conditions  we  obtained  for 
the  problem  of  optimally  controlling  an  uncertain  system.  These  conditions 
can  be  used  to  design  min max  controllers.  Recently,  our  investigation  has 
led  to  a more  general  sufficiency  result  which  includes  the  previous  results 
as  special  cases.  This  research  has  been  reported  in  a paper  which  has  been 
accepted  for  publication  in  the  Journal  of  Optimization  Theory  and  Applications 
and  is  included  as  Appendix  D. 

Often,  the  performance  of  a system  cannot  be  measured  by  a single,  scalar 
performance  index.  Instead,  multiple  criteria  are  needed  to  characterize  the 
system's  performance.  We  have  obtained  results  which  treat  the  problem  of 
designing  an  optimal  controller  for  a system  with  multiple  performance  criteria 
when  disturbances  are  present.  These  results  will  appear  in  an  invited  paper 
in  the  Journal  of  Optimization  Theory  and  Applications . Appendix  E is  a copy 
of  this  manuscript. 

Finally,  in  a previously  published  paper  on  static  rainmax  problems,  the 
proof  of  the  major  result  was  complicated  and  long.  We  have  devised  a simpler 
and  shorter  proof  and  this  proof  will  appear  as  a note  in  the  Journal  of 
Mathematical  Analysis  and  Application.  It  is  included  in  this  progress  report 
as  Appendix  F. 


III.  Research  in  Progress 

The  controllability  results  obtained  are  more  general  than  those  currently 
available  since  they  apply  to  time-varying  linear  systems  where  there  are 
constraints  on  the  controls.  Nevertheless,  the  results  are  not  as  general  as 
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they  need  to  be.  In  particular,  we  are  investigating  three  extensions  of  the 
results:  (i)  general  target  (rather  than  the  origin  as  a target),  (ii)  nonlinear 

systems  and  (iii)  systems  with  disturbances.  The  controllability  problem 
with  disturbances  is  being  investigated  in  conjunction  with  Bruce  Elenbogen, 
a graduate  student  in  Applied  Mathematics  who  is  being  supported  by  the  grant. 

It  is  believed  that  our  approach  to  controllability  problems  will  lead  to  results 
that  apply  to  nonlinear  systems. with  a general  target  and  disturbances . 

Sufficient  conditions  for  a minmax  control  are  now  well  developed  and  it 
is  felt  that  little  can  be  gained  by  making  minor  extensions  of  the  results 
currently  available.  Instead,  our  efforts  are  concentrating  on  the  develop- 
ment of  necessary  conditions.  It  is  quite  important  that  necessary  conditions 
be  developed  since  complex  problems  usually  require  numerical  solution  and 
necessary  conditions  lend  themselves  to  numerical  algorithms  more  readily 
than  sufficient  conditions.  Necessary  conditions  have  been  obtained  for 
linear  systems  with  a linear  cost  function.  However,  this  class  of  problems 
is  too  narrow  to  be  of  much  practical  use  and  we  are  attempting  to  extend 
the  ideas  to  problems  with  a quadratic  performance  index. 

IV.  Additional  Information 

Papers  resulting  from  the  research  sponsored  by  AFOSR  under  Grant  AFOSR  76-2923. 

1.  Static  Multicriteria  Problems;  Necessary  Conditions  and  Sufficient  Con- 
ditions, Proceedings  IFAC  Symposium  on  Large  Scale  Systems,  Udine,  Italy, 

June  16-20,  1976. 

2.  A Sufficient  Condition  for  Minmax  Control  of  Systems  with  Uncertainty  in 

the  State  Equations,  IEEE  Trans.  Auto.  Control.  Vol.  AC-21,  No.  4,  August  1976. 
(Also  in  Proceedings  1976  JACC.  Lafayette,  Indiana). 
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3.  Necessary  Conditions  and  Sufficient  Conditions  for  Static  Minmax  Problems, 

J.  Math.  Anal.  Applic.,  Vol.  57,  No.  2,  February  1977. 

4.  Minmax  Control  of  Systems  with  Uncertainty  in  the  Initial  State  and  in  the 
State  Equations,  IEEE  Trans.  Auto.  Control.  Vol.  AC-22,  No.  2,  April  1977 
(Also  in  Proceedings  1976  Conference  on  Decision  and  Control.  Clearwater 
Beach,  Florida). 

5.  A Note  on  the  Use  of  the  Direct  Sufficient  Conditions  in  Optimal  Control 
Problems,  J.  of  Optimization  Theory  and  Applic.,  Vol.  23,  No.  3,  Nov.  1977. 

6.  Profit  Maximization  Through  Advertising:  A Nonzero  Sum  Differential  Game 
Approach  (with  G.  Leitmann) . IEEE  Trans.  Auto.  Control,  Vol.  AC-23,  No.  4, 

August  1978. 

7.  Optimal  Control  of  the  End-Temperature  in  a Semi-Infinite  Rod  (with  W.  E. 
Olmstead) ,Zeitschrift  fur  angewandte  Mathematik  und  Physik,  Vol.  28, 

pp.  697-706,  1977. 

8.  Multicriteria  Optimization  With  Uncertainty  in  the  Dynamics,  Proceedings 
1977  Allerton  Conference  on  Communication,  Control  and  Computing, 

Monticello,  Illinois,  Sept.  28-30,  1977. 

9.  Optimal  Blowing  to  Reduce  Drag  (with  W.  E.  01mstead)i  SIAM  J.  Applied  Math, 

(to  appear) . 

10.  A Necessary  and  Sufficient  Condition  for  Local  Constrained  Controllability 
of  a Linear  System  (with  B.  R.  Barmish) , Proc.  1978  Allerton  Conference 

on  Communication,  Control  and  Computing,  Monticello,  Illinois,  Oct.  4-6,  1978. 

11.  Optimal  Control  of  Systems  with  Multiple  Criteria  When  Disturbances  are 
Present,  J.  of  Optimization  Theory  and  Applications,  Vol.  27,  No.  1,  Jan.  1979. 

12.  Constrained  Controllability  (with  B.  R.  Barmish),  Proc.  17th  IEEE  Conference 
on  Decision  and  Control.  San  Diego,  Calif.,  Jan.  10-12,  1979. 
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13.  A General  Sufficiency  Theorem  for  Minmax  Control,  J.  of  Optimization 
Theory  and  Applications,  Vol.  27,  No.  3,  March,  1979. 

14.  A Simple  Derivation  of  Necessary  Conditions  for  Static  Minmax  Problems, 
J.  Math.  Analysis  and  Applic.  (to  appear). 

15.  Constrained  Controllability  of  Linear  Systems  (with  B.  R.  Barmish) , 

SIAM  J.  On  Control  and  Optimization  (submitted). 


Conferences  and  Lectures  (Sept.  1977  - August  1978) 

I presented  an  invited  paper  on  multicriteria  optimization  at  the  1977 
Allerton  Conference  on  Communication,  Control  and  Computing,  Monticello,  Illinois, 
Sept.  1977. 


I attended  the  International  Forum  On  Alternatives  For  Multivariable 
Control,  Chicago,  Illinois,  October,  1977. 

I presented  an  invited  lecture  on  minmax  problems  at  Michigan  State 
University,  November,  1977. 

I chaired  a session  on  games  at  the  1977  Conference  on  Decision  and 
Control,  New  Orleans,  Louisiana,  December,  1977. 


Forthcoming  Conferences  and  Lectures 

I will  present  a paper  on  constrained  controllability  at  the  1978  Allerton 
Conference  on  Communication,  Control  and  Computing,  Monticello,  Illinois, 
October,  1978. 

I have  been  invited  to  give  a lecture  on  controllability  at  the  University 
of  Rochester,  November,  1978. 

I will  present  a paper  on  constrained  controllability  at  the  17th  IEEE 
Conference  on  Decision  and  Control,  San  Diego,  Calif.,  Jan.,  1979. 


Abstract.  The  paper  considers  the  problem  of  steering  the  state  of  a linear 
time-varying  system  to  the  origin  when  the  control  is  subject  to  magnitude 
constraints.  Necessary  and  sufficient  conditions  are  given  for  global  con- 
strained controllability  as  well  as  a necessary  and  sufficient  condition  for 
the  existence  of  a control  (satisfying  the  constraints)  which  steers  the 
system  to  the  origin  from  a specified  initial  epoch  (xo>to).  The  global 
result  does  not  require  zero  to  be  an  interior  point  of  the  control  set  Cl  and 
the  theorem  for  constrained  controllability  at  (xQ,to)  only  requires  that  fi 
be  compact,  not  that  it  contain  zero.  The  results  are  compared  to  those 
available  in  the  literature.  Furthermore,  numerical  aspects  of  the  problem 
are  discussed  as  is  a technique  for  determining  a steering  control. 
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1.  Introduction  and  Formulation.  Consider  the  problem  of  steering  the 


state  of  a linear  system 

(S)  x(t)  = A(t)x(t)  + B(t)u(t)  ; t € [t  ,■) 

o 

to  the  origin  from  a specified  initial  condition 

x(t  ) = * 
o o 

by  choice  of  control  function  u(*).  Here  x(t)  € Rn,  u(t)  € Rm  and  A(*)  and 
B(*)  are  continuous  matrices  of  appropriate  dimension.  Unlike  the  usual  con- 
trollability problem  where  the  control  values  at  each  instant  of  time  are 
unconstrained,  we  insist  here  that  the  control  values  at  each  instant  of  time 
belong  to  a prespecified  set  in  Rm. 

Let  rn(Cl)  denote  the  set  of  functions  from  R into  Q that  are  measurable 
on  [to>“).  Then  any  control  u(«)  €IU(Q)  is  termed  admissible.  We  now  define 
three  notions  of  constrained  controllability  or,  more  precisely,  Q-null 
controllability. 

Definition  1.1.  The  linear  system  (S)  is  Ci-null  controllable  at  (xo,tQ) 

if,  given  the  initial  condition  x(t  ) = x , there  exists  a u(»)  €iTl(Q)  such 

o o 

that  the  solution  x(*)  of  (S)  satisfies  x(t)  = 0 for  some  t € Lt  ,*) . 

Definition  1.2.  The  linear  system  (S)  is  globally  u-null  controllable 

at  t if  (S)  is  il-null  controllable  at  (x  ,t  ) for  all  x 6 Rn. 

o oo  o 

Our  results  will  pertain  to  the  above  two  types  of  controllability.  To 
compare  our  results  to  those  of  other  researchers,  we  also  need  a local 
controllability  concept. 

Definition  1.3.  The  linear  system  (S)  is  locally  fl-null  controllable 

at  t if  there  exists  an  open  set  VcRn,  containing  the  origin,  such  that 
o 

(S)  is  null  controllable  at  (x  ,t  ) for  all  x €v. 

o o o 


cv., 


showed  that  a necessary  and  sufficient  condition  for  global  Rm-null  controllability 


is  rank  (Q)  = n where  Q = [B,AB,*‘*,An  ^B].  Lee  and  Markus  L2]  considered 

constraint  sets  O^R111  which  contain  u = 0 and  showed  that  r(Q)  = n is  a 
necessary  and  sufficient  condition  for  (S)  to  be  locally  O-null  controllable. 
Furthermore,  if  each  eigenvalue  X of  A satisfies  Re (\)  < 0,  then  (S)  is  globally 
O-null  controllable.  This  result  is  typical  of  the  results  available  when  0 
contains  the  origin. 

Saperstone  and  Yorke  [3]  were  the  first  to  eliminate  the  assumption  that 

zero  is  an  interior  point  of  0 when  they  considered  problems  with  m = 1 and 

0 = [0,1].  Their  result  states  that  for  these  problems  (S)  is  locally  O-null 

controllable  if  and  only  if  rank  (Q)  = n and  A has  no  real  eigenvalues.  They 

also  extend  this  result  to  m > 1 and  0 = II™[0,l].  Problems  with  more  general 

constraint  sets  were  studied  by  Brammer  [4]  who  showed  that  if  there  exists 

a u€0  satisfying  Bu  = 0 and  the  convex  hull  of  0 has  a nonempty  interior,  then 

necessary  and  sufficient  conditions  for  local  O-null  controllability  are  rank  (Q)  = n 

T T 

and  the  nonexistence  of  a real  eigenvector  v of  A satisfying  v Bu  £ 0 for  all 
u € 0.  In  addition,  if  no  eigenvalue  of  A has  a positive  real  part  then  the 
theorem  becomes  one  for  global  0-null  controllability.  A similar  result  for 
global  controllability  when  0 = [0,1]  was  obtained  by  Saperstone  [5j. 


For  nonautonomous  systems,  the  most  familiar  controllability  result  is 

that  of  Kalman  [l]  when  0 = Rm.  He  showed  that  (S)  is  Rm-null  controllable 

if  and  only  if  W(t  ,t_)  is  positive  definite  for  some  t,  6 [t  ,°°)  where 
o 1 1 o 
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and  0(t,T)  is  the  state  transition  matrix  for  (S).  When  the  control  s con- 
strained, the  major  results  are  by  Conti  [6j  and  Pandolfi  C 7 j who  obtained 
necessary  and  sufficient  conditions  for  global  O-null  controllability  when  0 
is  the  closed  unit  ball. 

We  also  mention  the  results  on  O-null  controllability  of  Dauer  [8],  [9] 
and  Chukwu  and  Gronski  [10]  for  a class  of  nonlinear  systems  satisfying  a 
certain  "growth  condition".  In  [ll],  Grantham  and  Vincent  consider  the  prob- 
lem of  steering  a nonlinear  system  to  a target  and  present  a technique  for 
determining  the  boundary  between  the  set  of  states  which  can  be  steered  to 
the  target  and  those  which  cannot.  More  recently,  Murthy  and  Evans  [12] 
obtained  results  comparable  to  [3j-[5]  for  discrete  linear  systems  and  Pachter 
and  Jacobson  [l3]  developed  sufficient  conditions  for  controllability  for 
case  where  A(*)  and  B(*)  are  time  invariant  and  Q is  a closed  convex  cone 
containing  the  origin.  A readable  account  of  the  state  of  the  art  is  con- 
tained in  the  book  by  Jacobsen  [14,  Chapter  5], 

In  contrast  to  much  of  the  work  of  previous  authors,  this  paper  concen- 
trates on  the  case  where  A(-)  and  B(*)  are  time-varying.  Our  results  for 
global  O-null  controllability  are  for  constraint  sets  0 that  are  compact  and 
contain  zero  (but  not  necessarily  as  an  interior  point).  One  of  our  main 
results  on  global  O-null  controllability  is  an  extension  of  a theorem  of 
Conti  [6]  and  it  degenerates  to  Conti's  theorem  when  0 is  a unit  ball. 

Our  results  for  O-null  controllability  at  (x  ,t  ) have  even  wider 
applicability  since  they  do  not  require  the  existence  of  a u€0  such  that 
Bu  = 0.  Thus  we  can  analyze  controllability  of  a system  with,  for  example, 
m = 1 and  0 = _l,2j  whereas  the  presently  available  theorems  do  not  apply. 
Furthermore,  as  will  be  illustrated  by  examples,  there  are  autonomous  systems 
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(S)  which  are  neither  globally  Q-null  controllable  nor  locally  Q-null  con- 
trollable but  nevertheless  are  Q-null  controllable  at  some  (x  ,t  ).  Our 

o o 

theorem  can  be  used  to  decompose  the  state  space  into  two  sets.  Initial 
states  in  one  set  can  be  steered  to  the  origin  while  those  in  the  other 
cannot  be  driven  to  the  origin  by  an  admissible  control. 

2.  Main  Results.  In  order  to  describe  our  necessary  and  sufficient 
conditions  for  global  Q-null  controllability,  we  make  use  of  the  support 
function  : Rm-,Rtl  [“}  on  Q which  for  any  or  € Rn  is  given  by 

Hq(Q')  = sup  £ uu 1 a : uu  6 Q} 

Using  this  notation,  we  have  the  following  theorem,  which  is  proved  in 
Apppendix  A. 

Theorem  2.1.  Suppose  Q is  a compact  set  which  contains  zero.  Then,  (S) 
is  globally  Q-null  controllable  at  tQ  if  and  only  if 


(2.1) 


j H^(B 1 (t) z (T) )dT  = + 


for  all  non-zero  solutions  z(*)  of  the  adjoint  system 


z(t)  = -A'(t)z(t);  t € [t  ,®) 

o 


Equivalently,  if  and  only  if 


suptm'B' (T)0' (t  ,T)\  : uu€Q}dT  = + 
Co 


for  all  \ 6 R , \ ^ 0,  where  0(t,T)  is  the  state  transition  matrix  for  (S) . 

In  the  following  corollary,  we  examine  the  special  case  of  Theorem  2.1 
which  arises  under  the  strengthened  hypothesis  "zero  is  an  interior  point  of  Q." 
As  we  might  anticipate,  for  this  special  case,  the  structure  of  the  set  Q will 
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not  matter  other  than  the  requirement  that  it  contains  zero  in  its  interior. 

Corollary  2.2.  (See  Appendix  A for  proof):  Suppose  there  exists  a 
compact  set  (1  such  that 

(i)  zero  is  an  interior  point  of  0; 

(ii)  (S)  is  globally  fl-null  controllable. 

Then  (S)  is  also  globally  -null  controllable  for  any  other  set  O'  (not 
necessarily  compact)  which  contains  zero  in  its  interior* 

Our  proof  of  Theorem  2.1  will  make  use  of  a more  fundamental  result 
(also  proven  in  Appendix  A)  giving  conditions  for  Q-null  controllability  at 
a fixed  initial  epoch  (x  ,t  ).  To  meet  this  end,  we  define  the  scalar 
function  J:Rn*RxR  “R  by 


(2.2) 


rT 

J(xo,T,X)  = x^9 ' (T , tQ) X + j Hq(B' (t)9' (T,T)X)d" 


Since  we  will  only  consider  compact  Q in  the  sequel,  we  can  guarantee  (see 
Appendix  A)  that  the  integrals  (2.1)  and  (2.2)  are  well  defined. 

Theorem  2.3.  Let  Q be  a compact  set  and  suppose  A is  any  subset  of  R 
which  contains  0 as  an  interior  point.  Then  (S)  is_  w-null  controllable _at 


(x  , t ) if  and  only  if 
o o 


(2.3) 


min[j(x  ,T,X)  : X€A}  - 0 


for  some  T € [t  ,”) . Equivalently, 

(2.4)  J(x  ,T,\)  * 0 for  all  X6A 


for  some  T € [t  ,“) . 

o 


Implicit  in  the  statements  of  Theorem  2.1  and  Theorem  2.3  is  the  fact 
that  H^(B' (t)z(t) ) is  an  integrable  measurable  function  of  T along  all 
trajectories  z(*)  of  (S').  This  fact  is  established  as  a lemma  in  Appendix  A. 


Theorem  2.3  can  also  be  stated  in  terms  of  the  adjoint  system  (S'). 

i.e.,  if  we  take  A = Rn  and  notice  that  z(t)  = 5 1 (t  ,t)z(t  ) is  the  response 

o o 

of  the  adjoint  system  (S'),  then  the  following  theorem  is  easily  proven. 

a 

(The  proof  is  established  by  making  the  change  of  variables  z(t)  = 0'(T,t)X). 

Theorem  2.3'.  Let  A satisfy  the  hypothesis  of  Theorem  2.3.  Then  (S) 

is  A-null  controllable  at  (x  ,t  ) if  and  only  if  there  exists  some  T€[t  ,«0 
— ■ o o — ‘ o 

such  that 


(2.5) 


x'z(t  ) + H~(B' (T)z(T) )dT  S o 

O O «J  w 

o 


for  all  solutions  z(*)  o_f  (S'). 

This  theorem  demonstrates  that  the  question  of  constrained  controllability 

at  (xQ,to)  can  be  answered  by  solving  a finite  dimensional  optimization  problem. 

Moreover,  the  question  of  global  A-null  controllability  can  also  be  answered 

via  a finite  dimensional  optimization  problem.  This  result  is  given  as 

Corollary  2.4.  Let  A and  A be  as  in  Theorem  2.3.  Then  (S)  i_s  A-null 

controllable  at  t if  and  only  if  for  every  x € Rn  there  is  a time  T £ [t  .<*>) 

o ■ o x o’ 

o 

such  that 

min{j(x  ,T  , \)  : \€A}  = 0 
o x 

o 

The  proof  of  this  corollary  follows  from  Theorem  2.3  in  conjunction  with 


the  definition  of  global  A-null  controllability. 

There  is  one  technical  point  worth  noting.  In  using  Theorem  2.1  to 
check  for  A-null  controllability  at  tQ,  A must  be  compact  and  contain  0.  If 
Corollary  2.4  is  used,  only  the  compactness  assumption  must  be  satisfies 

Next,  we  present  some  examples  to  illustrate  how  our  theorems  can  be  applied 
and  to  compare  our  results  to  those  of  [3-5]. 


» 
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Example  1,  Let  x(t)  and  u(t)  be  scalars  and  suppose  (S)  is  described  by 
x(t)  = x(t)  + u (t)  , t € Co,00) 

This  system  is  Rm-null  controllable  if  Q = Rm.  But  suppose  D = [o,l].  Then 

the  system  is  not  globally  G-null  controllable  at  t =0.  This  follows  from 

° p" 

Theorem  2.1  since,  for  z <0,  H-,(B'  (t)z(t)  ) = 0 and  thus  H-,(B'  (t) z (t) dr  < + 

o 

Also,  using  C 3 j or  [4]  it  can  be  shown  that  the  system  is  not  locally  Q-null 

controllable.  Nevertheless,  there  do  exist  initial  states  x from  which  it 

o 

is  possible  to  steer  the  system  to  the  origin.  Such  states  can  be  determined 
via  Theorem  2.3. 


For  tne  above 


J(x  ,T,X)  = x e X + sup{u)e  X : uj  € [0,  l]}dT 

O O d 

O 


When  A = [-l,l],  this  becomes 


J(xo,T,\) 


f T, 

x e X 
i 0 

) XQeT\  + \(eT  - 1) 


\ * 0 


\ > 0 


and  thus 


min[j(xo,T,\)  : X€[-l,l]}  = 0 


if  and  only  if  x^  S 0 and  xq  > e - 1 for  some  T€[0,®),  or  equivalently, 

if  and  only  if  -1  < x^  S 0.  We  conclude  that  even  though  (S)  is  not  locally  H-null 

controllable.it  is  Q-null  controllable  at  (x  ,0)  if  and  only  if  -1  < x £ 0. 

o o 

If  Q = [l,2],  neither  [3-6]  nor  Theorem  2.1  apply.  However,  we  can 
use  Theorem  2.3.  Since 


1 2Xe 


(T-t) 


Hn(B'(T)0'(T,T)X  = / 


(T-t) 


X > 0 


xso 


J (xq,T , X)  becomes 

J(xq,T,\) 


xoeT\  + 2X(eT  - 1) 

T T 

XQe  X + X(e  - 1) 


X > 0 
XSO 


and 

mintJ(xo>T,X)  : X€[-l,l]}  = 0 

if  and  only  if  -2  < x £ 0.  Thus  (S)  with  G = [l,2]  is  G-null  controllable 

o 

at  (x  ,t  ) when  -2  < x S 0. 
o o o 

As  a final  variation  of  this  problem,  suppose  G = [-a, a].  Then  1.4]  or 
Theorem  2.1,  shows  that  (S)  is  not  globally  G-null  controllable.  Using  [4], 
it  can  be  demonstrated  that  S is  locally  G-null  controllable  while  Theorem  2.3 
not  only  tells  us  that  S is  locally  G-null  controllable  but  also  that  the 
states  xq  which  can  be  steered  to  the  origin  are  those  satisfying  -a  < x^  < a. 

Example  2.  Our  second  example  illustrates  the  apolication  of  our 
constrained  controllability  criteria  for  a two-dimensional  system.  We  con- 
sider the  time-varying  system  (S)  described  by 


xx(t)  = -x1(t)  + x2(t)  + u(t)  ; 


x2(t)  = -tx2(t)  ; t€[0,»)  . 

First,  we  compute  the  solution  z(*)  of  the  adjoint  system  (S') 

t 

I 6 

z(t) 


8(t)  e 


t2/2 


where 


2 ■ s • 2 

0<t)  = -i  e d$ 


o 
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Consider  Cl  - [-M,M],  In  accordance  with  Theorem  2.1,  (S)  is  globally  Cl-null 


controllable  at  t = 0 if  and  only  if 


p®  e 

i mCo  1] 


0(T)  e ' 


for  all  non-zero  initial  conditions  z = [z..  z ]'.  Expanding  above,  this 

o ui  uz 

reduces  to  the  requirement 
00 

f Ml1z„1|eTdT  = +co  for  all  (zQ1  zQ2)  + 0 


J J 1 0 1 

o 


which  is  violated  by  zQ1  = 0;  z^2  = anything  non-zero.  Hence  (S)  is  not 

globally  f2-null  controllable  at  tQ  = 0. 

On  the  other  hand,  perhaps  certain  specified  initial  conditions  can 

T 

be  steered  to  zero.  For  example,  if  xq  = [T,  0]  , then  we  require  by 

Theorem  2.3'  that 

T 

XoZo  + I M'z01leTdT  * ° £°-r  (Z01  Z02}  * ° 

o 

for  Cl- null  controllability  at  (0,xq).  Substituting  for  the  given  xq,  this 
requirement  becomes 

rT  t 

Tlz01  + J Ml zq1  1 e dT  s 0 for  all  z01€r 
o 

Clearly,  this  can  be  accomplished  if  T is  large  enough  so  that 


rT..  t 


J Me  dT  s 7) 


Wc  also  could  have  derived  this  same  result  by  invoking  Theorem  2.3  instead 


of  Theorem  2.3' . 
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3.  Relationship  with  Other  Controllability  Results.  In  this  section, 
we  compare  our  controllability  results  with  those  of  Conti  [6]  and  Brammer  [4j. 

We  also  consider  as  a limiting  case  of  our  theory  the  usual  controllability 
problem  obtained  when  magnitude  constraints  are  riot  present. 

Result  of  Conti.  An  important  special  case  of  Theorem  2.1  occurs  when  £1 
is  a closed  unit  ball  in  R™  i.e., 

Q = U€Rm  : limit  * l] 

where  j|«lj  is  a prespecified  norm  on  Rm.  For  this  situation  we  have 
Hq(B'(t)z(t))  = supluu-B'(T)z(T)  : i|oJ||  * l}  = ||B'  (t)z(t)||^ 

where  ||*j|  is  the  norm  on  Rm  which  is  dual  to  |j*||.  (For  example  is  the 

^ norm  when  ||*||  is  the  l norm  and  ||*||  and  ||«||  coincide  when  j|*||  is  the 
2 

usual  l (Euclidean)  norm.) 

By  Theorem  2.1,  we  conclude  that  (S)  is  globally  Q-null  controllable 

at  t if  and  only  if 
o 

CO 

(3.1)  j ||B'  (T)z(T)||*dT  - + - 

t 

o 

for  all  non-zero  solutions  z(’)  of  (S').  This  result  is  established  independently 
in  Conti  [6]  and  also  discussed  in  Pandolfi  L7j.  This  result,  in  conjunction 
with  Corollary  2.2  leads  immediately  to  the  following  Proposition.  < 

Proposition  3.1.  Let  Tl  be  any  set  containing  zero  in  its  interior.  Then 
(3.1)  is  a necessary  and  sufficient  condition  for  global  P.-null  controllability. 

Thus,  Conti's  condition  is  a necessary  and  sufficient  condition  for 
global  £)-null  controllability  for  any  set  £1  containing  zero  in  its  interior, 
not  just  when  £1  is  the  closed  unit  ball. 
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Result  of  Brammer.  Consider  the  case  when  A(t)  = A and  B(t)  = B are 
time-invariant.  Furthermore,  assume  u satisfies  the  following  conditions: 
there  exists  a u € fl  satisfying  Bu  = 0 and  CH(fl)  has  a nonempty  interior  in  Rm. 
For  this  special  case,  Theorem  2.1  is  comparable  to  Brammer's  result. 

Theorem  3.2.  (S)  is  globally  .1-null  controllable  if  and  only  if 

i)  r (Q)  - n 

ii)  there  is  no  real  eigenvector  v of  A'  satisfying  v'Bo)  £ 0 for  all  x € Q 

iii)  no  eigenvalue  of  A has  a positive  real  part. 

We  note  that  the  system  of  Example  1 of  Section  2 does  not  satisfy  these 

three  conditions.  Nevertheless,  it  is  H-null  controllable  at  (x  , t ) for 

o o 

some  initial  states  x . 

o 

The  Case  il  ■ Rm.  When  f)  = Rm,  it  is  well  known  [15,  p.  17 13 

that  the  time-varying  system  (S)  is  completely  controllable  (globally  Rm-null 

controllable  at  tQ  in  our  notation)  if  and  only  if  the  rows  of  0(t  , •)B(*) 

are  linearly  independent  on  some  bounded  interval  [t  ,T],  Here  we  show  that 

o 

when  Q = Rm,  equation  (2.1)  is  a necessary  and  sufficient  condition  for  global 

Rm-null  controllability.  This  is  accomplished  by  showing  that  (2.1)  is 

equivalent  to  the  rows  of  0(t  ,*)B(*)  being  linearly  independent  on  some 

bounded  interval  Lt  ,t], 
o 

Proposition  3.3 . (S)  is  globally  Rm-null  controllable  if  and  only  if 

CO 

I H (B'  (T)z(T)dT  = + ® 

Jt  Rm 
o 

for  all  non-zero  solutions  z(«)  of  (S'). 

The  proof  of  this  result  is  in  Appendix  B. 


■n- 


4 
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4.  Some  Computational  Aspects.  In  some  problems,  one  may  have  to  resort 

to  the  computer  to  check  whether  or  not  a system  is  ft-null  controllable.  When 

using  Equ.  (2.3),  a solution  of  the  minimization  problem  mim.J(xo,T,  X)  : XSA}  is 

needed.  Direct  application  of  so-called  gradient  or  descent  algorithms  is  precluded 

by  the  fact  that  J(x  ,T,X)  is  in  general  not  differentiable  in  X.  This  fact  is 

o 

a consequence  of  the  sup  operation  involved  in  the  definition  of  H„(B' (t) § ' (T, t) X) . 

ii 

Fortunately,  however,  numerical  computation  is  nevertheless  feasible  as  a con- 
sequence of  the  following  two  lemmas.  The  proofs  are  given  in  Appendix  C. 

Lemma  4.1.  For  fixed  (x  ,T)€RnXR,  J(x  ,T,X)  is  a lower  semicontinuous 
o o 


convex  function  of  X. 


++ 


Lemma  4.2.  For  fixed  (xq,T)  €R  *R,  the  subdifferential  of  J(x  ,T,*) 

at  X 6 Rn  consists  of  all  vectors  X,  £ Rn  of  the  form 

-■  - * ■ ■ - ■ - 

T 

(4.1)  X*  = 5(T,to)xQ+  j $(T,T)B(T)u)*(T)dT 

Co 

where 

(4.2)  (d*(t)  € arg  max{u)'  B ' (t)$  1 (T,  t)  X : uu  € Cl} 
for  almost  all  t€[o,Tj. 

Formulae  (4.1)  and  (4.2)  hold  for  arbitrary  compact-convex  Q.  Often, 
however,  more  structural  information  is  known  about  0.  In  such  cases,  (4.1) 
and  (4.2)  may  simplify.  To  illustrate,  suppose 

.1  = L-m.  ,M  j x [-M0,M0]  X ...  X r.M  ,M  ] ; (M.  > 0) 

i i z z mm  l 


The  so-called  "generalized  steepest  descent"  schemes  rely  on  subdifferential 
rather  than  gradient  information.  Hence  computations  can  be  carried  out 
using  the  subdifferential  description  of  J(xq,T,X)  given  in  Lemma  4.2. 
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Then,  the  maximum  in  (4.2)  is  achieved  in  the  iC^  component  by 

[u).(t)3.  £M  sgn[B'  (t)S'  (T , t) X]  ; i = l,2,...,m 
^ 11  l 

where  sgn  x s 1 if  x > 0;  sgn  * -1  if  x < 0;  sgn  0 = [-1,1].  Consequently, 

for  this  case,  we  can  substitute  in  (4.1)  and  show  that  the  subdifferential 

Sj(x  ,T,\)  consists  of  all  vectors  X 6 Rn  of  the  form 
o * 

(4.3)  X = 4(T,0)x  + r I M.h. (T.T)sgn  X'h.(T,T)dT 

^ O v 1—  111  1 


where  h^T.T)  is  the  iC^  column  of  H(T,r)  = S(T,t)B(t). 

We  also  note  that  X^  is  uniquely  specified  by  (4.3)  if 

measured  : X'  h^(T,T)  = 0}  = 0 for  i = l,2,...,m 

For  such  X,  Bj(x  ,T,X)  is  precisely  v.J(x  ,T,X),  the  gradient  of  J(x  ,T,*)  at  X. 
o K o o 

5.  The  Steering  Control.  Using  the  results  of  Section  2,  we  can  determine 
if  (S)  is  (1-null  controllable.  However,  those  results  do  not  give  a method 
for  determining  a steering  control  u^(-)  € iT» (Q)  which  accomplishes  this 
objective . 

One  method  of  determining  an  appropriate  u^(>)  is  to  solve  the  time  optimal 
control  problem,  i.e.,  find  u^(*)^^(0)  which  steers  (S)  from  given  (x^,^)  to  the 
origin  and  does  so  in  minimum  time.  If  there  is  a control  which  steers  the 
system  to  the  origin,  then  there  is  a time  optimal  one  [2].  Hence,  in  principle, 
a steering  control  can  be  numerically  computed  using  any  of  a wide  variety 
of  algorithms  which  are  available  for  solution  of  the  time  optimal  control 
problem. 

Since  the  solution  of  the  time  optimal  problem  is  determined  by  solving 
a two  point  boundary  value  problem,  it  can  be  quite  difficult  to  obtain  the 


*'•  .. 


steering  control  this  way.  In  this  section, a "simpler"  alternative  method  for 

generating  a steering  control  is  presented.  This  technique  does  not  involve 

a two  point  boundary  value  problem  and  leads  to  a control  which  steers  the 

system  arbitrarily  close  to  the  origin.  Our  result  is  obtained  from  the 

following  minimum  norm  problem: + Given  initial  point  (xo,tQ)  and  a final 

time  T,  find  u(«)  €iL(D)  which  leads  to  the  smallest  value  of  ||x(T)l|.  The 

solution  of  this  minimum  norm  problem  is  characterized  in  the  next  theorem. 

Theorem  5.1.  (See  Appendix  D for  proof).  Let  (x  ,t  ) and  T be  given. 
——————  — o o 

Suppose  that  6 Rn  achieves  the  minimum  of  J(xo>T,\)  over  the  closed  unit  ball. 
Then  any  solution  of  the  minimum  norm  problem  satisfies 

(5.1)  u*(T)  € ar8  max{  id'  B ' (t)0'  (T,t)  X*  : <jj  6 f)} 

for  almost  all  t € [t  ,t]. 

o 

We  note  that  condition  (5.1)  will  uniquely  determine  u^(")  whenever  the 
minimum  of  uj'  B'  (T)0  ' (T,  T)  X is  uniquely  achieved.  For  example,  suppose 

(1  = [-M..M-]  X X ...  X [-M  ,M  ] (M.  > 0)  . 

i i z z mm  l 

Then  (5.1)  requires 

(5.2)  Cu*(t)]1  € M.sgnCBl(T)0'(T,T)^]i  , i=l,2,.-.,m  . 

For  the  case  when  the  minimum  of  |jx(T)|i  = 0,  X = 0 and  (5.1)  will  not 
determine  a control  which  steers  (S)  to  the  origin.  The  following  heuristic 
procedure  can  be  used  to  determine  a control  which  steers  (S)  arbitrarily  close 
to  the  origin:  Choose  a T such  that  the  minimum  of  ||x(T)i|  is  nonzero.  As  T is 
increased,  the  minimum  of  ||x(T)|]  approaches  zero  and  the  corresponding  solution 
u^(*)>  generated  via  (5.2),  of  the  minimum  norm  p’-cblem  results  in  a control 
which  steers  the  system  progressively  closer  to  the  origin. 

(S)  here  is  required  to  be  Rra-null  controllable. 


ar" 
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6.  Additional  Applications.  In  this  section,  we  use  our  results  to  obtain 
an  existence  theorem  for  the  time  optimal  control  problem  and  also  apply  our 
results  to  a pursuit  game. 

Existence  of  Time  Optimal  Controls.  Consider  the  following  time  optimal 
control  problem:  Find  u(*)  €iL(0)  which  drives  the  state  x(»)  of  (S)  from  an 
initial  position  x(tQ)  = x^  to  the  origin  and  minimizes 

rtf 

C(u(*))  =1  dt  j t = arrival  time  at  the  origin. 

t f 

o 

The  classical  theorem  for  existence  of  a time  optimal  control  (e.g.,  Lee  and 
Markus  [2])requires  that  there  is  at  least  one  control  which  transfers  the 
state  x(-)  of  (S)  to  the  origin.  Combining  the  result  of  [2J  with  our 
Theorem  2.3,  we  obtain  the  following  existence  lemma. 

Lemma  6.1.  There  exists  a solution  to  the  time  optimal  control  problem 
if  and  only  if  there  is  some  finite  t^  € [t  ,“)  such  that 

min  {J(xo,tf,X)  : \€A}  = 0 

Furthermore,  the  time  optimal  cost  is  given  by 

C (u*(0)  = inf{tf  : min[j(xQ, tf , X)  : X € A J = 0 } 

Pursuit  Games.  Next,  we  consider  the  pursuit  game  studies  by  Hajek  [l4j. 
The  system  is  described  by 


(6.1)  x(t)  = Ax(t)  - p(t)  + q(t)  ; p(t)  €p  , q(t)  6q 


x(t  ) = x 
o o 


where  P and  Q are  compact  convex  subsets  of  R . The  pursuer  p(-)  seeks  a 
strategy  a:  Q x [t  ,•)  -*  P which  steers  x(*)  to  the  origin  for  all  possible 
quarry  controls  q(*)  : [tQ,®)  “*  Q.  A quarry  control  is  admissible  if  it  is 
measurable  and  a strategy  is  admissible  if  c(*)  preserves  measurability. 


J 
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In  [ 16] , a solution  to  this  problem  is  obtained  in  terms  of  the  associated 
control  system 


(6.2) 


y(t)  = Ay (t)  - u(t)  ; u(t)  €p  - Q ; y(tQ)  = 0 


where  P - Q is  the  Pontryagin  difference,  i.e., 


* A <■  - n _ 

P - Q = {x  € R : x + Q^p] 


Admissible  controls  u(*)  above  must  be  measurable. 

Simply  put,  Hajek's  result  says  that  the  state  x(*)  of  (6.1)  can  be  forced 
to  the  origin,  for  all  admissible  q(‘),  if  and  only  if  the  state  y(-)  of  (6.2) 
can  be  steered  to  the  origin.  More  precisely,  the  following  theorem  is  available. 

First  Reciprocity  Theorem  [ 16] . Initial  position  x^  in  (6.1)  can  be 
(stroboscopically)  forced  to  the  origin  at  time  T ^ t by  a strategy  a(*)  if 
and  only  if.  x^  in  (6.2)  can  be  steered  to  the  origin  at  time  T by  an  admissible 
control  u( • ) . Furthermore , a(*)  and  u ( • ) are  related  by 

(f  j a(q,t)  = u(t)  + q 


By  applying  Theorem  2.3  to  (6.2),  we  obtain  another  condition  for  determining 


if  (6.1)  can  be  forced  to  the  origin. 


Lemma  6,2.  Assume  P - Q compact.  Then  x^  in  (6.1)  can  be  forced  to  the 


origin  at  time  T ^ t by  a strategy  a(.)  if  and  only  if 


min[K(x  ,T,\)  : X € A]  = 0 
o 


where 


K(x 


+ r We*’ <T ' T> 


t Vq'e :‘*dT 


and  A is  any  subset  of  R containing  zero  as  an  interior  point. 


Ji 
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It  should  be  pointed  out  that  in  addition  to  pursuit  game  interpretation 
of  (6.1),  (6.1)  can  also  be  viewed  as  a problem  of  steering  a system  with 
disturbances  to  the  origin  if  q(*)  is  thought  of  as  a disturbance.  Also,  the 
results  apply  to  systems  described  by 

x(t)  - Ax(t)  + Bp (t)  + Cq(t)  ; p(t)  €p  , q(t)  €Q 
if  one  replaces  Bp(t)  by  p'(t),  Cq(t)  by  -q'(t),  P by  BP  and  Q by  CQ. 


References 


I.  R.  E.  Kalman,  Mathematical  description  of  linear  dynamical  system,  this 
Journal,  1 (1963),  pp.  152-192. 

E.  Lee  and  L.  Markus,  Foundations  of  Optimal  Control  Theory.  John  Wiley, 

New  York,  1967.  

S.  Saperstone  and  J.  Yorke,  Controllability  of  linear  oscillatory  systems 
using  positive  controls,  this  Journal,  9 (1971),  pp.  253-262. 

4.  R.  Brammer,  Controllability  in  linear  autonomous  systems  with  positive 
controllers , this  Journal,  10  (1972),  pp.  339-353. 

5.  S.  Saperstone,  Global  controllability  of  linear  systems  with  positive 
controls , this  Journal,  11  (1973),  pp.  417-423. 

6.  R.  Conti,  Teoria  del  Controllo  e del  Controllo  Ottimo,  UTET,  Torino, 

Italy  1974. 

7.  L.  Pandolfi,  Linear  control  systems:  controllability  with  constrained 
controls , Journal  of  Optimization  Theory  and  Applications,  19  (1976), 
pp.  577-585. 

8.  J.  Dauer,  Controllability  of  nonlinear  systems  using  a growth  condition. 
Journal  of  Optimization  Theory  and  Applications,  9 (1972),  pp.  90-98. 

9.  J.  Dauer,  Controllability  on  nonlinear  systems  with  restrained  controls, 
Journal  of  Optimization  Theory  and  Applications,  14  (1974),  pp.  251-262. 

10.  E.  Chukwu  and  J.  Gronski,  Controllability  of  Nonlinear  Systems  with  Restrained 
Controls  to  Closed  Convex  Sets , Department  of  Mathematics  Report  CSUMD  45, 
Cleveland  State  University. 

II.  W.  J.  Grantham  and  T.  L.  Vincent,  A controllability  minimum  principle, 

Journal  of  Optimization  Theory  and  Applications,  17  (1975),  pp.  93-114. 

12.  M.  E.  Evans  and  D.  N.  P.  Murthy,  Controllability  of  discrete-time  systems 
with  positive  controls,  IEEE  Automatic  Control,  AC-22  (1977),  pp.  942-945. 

13.  M.  Pachter  and  D.  H.  Jacobson,  Control  with  conic  constraint  set,  Journal 
of  Optimization  Theory  and  Applications  (to  appear). 

14.  D.  H.  Jacobson,  Extension  of  Linear-Quadratic  Control,  Optimization  and 
Matrix  Theory,  Academic  Press,  New  York,  1977. 

15.  C.  T.  Chen,  Introduction  to  Linear  System  Theory,  Holt,  Rinehart  and 
Winston,  New  York,  1970. 

16.  0.  Hajek,  Pursuit  Games,  Academic  Press,  New  York,  1975. 

17.  P.  R.  Halmos , Measure  Theory,  Van  Nostrand,  New  York,  1950. 


19 


S.  Lang,  Analysis  I,  Add is on- Wes  ley , New  York,  1969. 

W.  Rudin,  Real  and  Complex  Analysis,  McGraw-Hill,  New  York,  1966. 

I.  Eke land  and  R.  Teman,  Convex  Analysis  and  Variational  Problems, 

North-Holi and , Amsterdam,  1976. 

H.  L.  Roydon,  Real  Analysis.  MacMillan  Co.,  New  York,  1968. 

R.  T.  Rockafellar , Convex  Analysis,  Princeton  University  Press,  Princeton,  NJ, 
1972. 

R.  T.  Rockafellar,  Conjugate  Duality  and  Optimization,  monograph,  SIAM 
Publications,  Philadelphia,  Pa.,  1974. 


R.  T.  Rockafellar,  Duality  and  stability  in  extremum  problems  involving 
convex  function.  Pacific  J.  Math.,  21  (1967),  pp.  167-187. 


APPENDIX  A 

Proof  of  Theorems  2.1,  2.3  and  Corollary  2.2.  Before  proving  our  theorems, 

we  need  two  preliminary  lemmas  which  guarantee  that  the  integrals  in  (2.1), 

(2.2)  and  (2.5)  are  well-defined.  To  simplify  our  notation,  we  henceforth  take 

t =0,  without  loss  of  generality.  First,  we  show  that  the  integrand  in  (2.1) 
o 

is  a non-negative  measurable  function  and  hence  the  integral  in  (2.1)  is  well- 
defined  [17], 

Lemma  A . 1 . Suppose  that  Q is  compact  and  contains  zero.  Then  the  Integrand 
H^(B ' (t)z(t))  is  a non-negative  measurable  function  of  t € [0,®)  along  all 
trajectories  z(*)  o_f  (S'). 

Proof : The  non-negativity  of  the  integrand  follows  from 
H^(B'  (t)z(t))  = sup{iu 'B ' (t)z(t)  :w€Q.} 

2 u,'B’(t)z(t)1u>=0 
= 0 

To  establish  measurability,  we  first  extract  a countable  dense  subset 

(u)  ) .of  n.  This  is  always  possible  because  Q is  compact  [18,  p,  146],  For 
n n=  l 

each  fixed  t,  the  density  of  the  implies  that 

H^(B  ' (t)z(t))  = sup  oTB^(t)z(t)  . 


Hn(T)  = uj^B' (t)z(t)  ; n = 1,2,... 


Then  each  H (•)  is  measurable  (in  fact,  continuous)  and  H_(B'(*)Z(’)  is  the 

n fj 

pointwise  supremum  over  the  family  of  Hn(*).  Theorem  1.14  of  Rudin  [l9j  tells 
us  that  the  pointwise  supremum  of  this  collection  must  also  be  measurable.  □ 
The  next  lemma  shows  that  the  integrals  (2.2)  and  (2.5)  are  well-defined. 


R 


m 
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Lemma  A. 2.  Suppose  that  Q is  compact  (not  necessarily  containing  zero) , 
Then,  for  each  fixed  pair  (X,T)  € Rnx  [0,®),  the  integral 

i»T 


j Hn(B,(T)«'(T,T)X)dT 
u o 1 

is  well-defined. 

Proof.  For  any  fixed  u ( • ) €1X1  (Q)  and  initial  condition  x , the  unique 
solution  of  (S)  is  given  by 

x(t)  = 0(t,O)xQ+J  0(t,T>B(T)u(T)dT 
o 

Let  u.  (•)  6m  (n)  be  a measurable  selection  such  that 

X 

sup{au 'B  ' (t)0  ' (T,t)\  : oj  € O’!  = u^(t)B'  (t)0  ' (T,r)X 

Such  a selection  is  possible  using  Theorem  1.2  of  [20,  p.  236],  Consequently, 
it  follows  that 

T T 

J Hn(B'(T)0'(T,T)X)dT  = J u^(t)B'(t)0'(T,t)X  dr 


= X'  ' 0(T,T)B(r)u^(T)dT 
o 

We  notice  that  the  integral  above  is  well-defined  because  it  is  the  unique 

solution  of  (S)  at  time  t = T,  corresponding  to  input  u (•)  and  initial 

X 


condition  x =0. 
o 


Since  Theorem  2.3  is  used  in  the  proof  of  Theorem  2.1,  we  first  present 

the  proof  of  Theorem  2.3.  There  are  various  ways  to  prove  Theorem  2.3.  Our 

chosen  method  of  proof  seems  to  be  most  natural  — our  proof  not  only  decides 

on  existence  of  a steering  control  u^(«),  but  also  characterizes  u^(*)  as  half 

★ 

of  a saddle  point  (X^;u  (*))  of  an  appropriately  constructed  functional 
v : Rnxm(n)-  R. 
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Proof  of  Theorem  2.-3  (Necessity):  We  suppose  that  (S)  is  O-null  control- 
lable at  (x  ,t  ).  Let  u.(«)€m(0)  be  a control  which  drives  x to  zero  at 
oo  ~ o 

some  future  time  T£[0,«°).  Then 


(A.l) 


x.(T)  = 0 = 5(T,0)x  + j $ (T,T)Bufc(T)dT 

o 


For  this  value  of  T,  we  are  going  to  show  that  J(xq,T,X)  is  non-negative  for 
all  \€Rn.  We  proceed  as  follows:  Using  the  measurable  selection  theory  of 
[20],  we  make  a measurable  selection  u^ C • ) € TU  (C/)  such  that 


(A. 2) 


sup{\'$(T,t)B(t)uj  : it  £ Ql  = (T,t)B(t)u^(t) 


Hence,  it  follows  that 


(A. 3) 


T T 

f H_  (B ' (t) 5 1 (T ,r)\)dT  = | sup{X'§  (T,t)B(t)u>  : u:  £ OVt 
J U « _ 


= j X'5(T,T)B(T)u^(T)dT 


sup|  j X'5  (T,T)B(r)u(T)dT  : u(-)  €TU (Q)J- 


But  also 


f nT  > <*T  r -> 

sup-!  ' X'§(T,T)B(T)u(T)dT  : u(-)  6m(0)|  * j sup^X'S  (T,t)B(t)uj  : u>  £ n|  dT 

" J n n 


(A.  4) 


Equations  (A. 3)  and  (A. 4)  imply 


j Hn(B'(T)§'(T,T)X)dT 
o 1 


(A. 5)  [ Hn(B'(T)5  '(T,T)X)dT  = sup{  j X ’*  (T,T)B(r)u(T)dT  : u(  • ) 6 in  (P.)j 


Now, 


rT 

J(xo,T,\)  = \,S(T,0)xo+j  Hn(B’(T)%i(T,T)X)dT 


f'T 

* \'5  (T,0)x  + supi  \'4  (t,T)B(-r)u(T)  : u(*)  €in(n)j 

O - * 


r 1 

2 \'S(T,0)X  + j \'®(T,T)B(T)u<t(T)dT 


= X'x*(T) 

= 0 . 

Therefore  J(xq,T,X)  £ 0 for  all  X€A.  Since  0€A  and  J(xo>t,0)  = 0,  we  conclude 
that 

min{ J(xq,T,X)  : X€A}  = 0 

(Sufficiency):  We  assume  that  there  exists  some  T€[0,=°)  such  that  the  mini- 
mum in  (2.3)  is  zero.  We  are  going  to  construct  a control  function  u^(-)  in 
Hi  (0)  which  steers  xq  to  0 at  time  T.  First,  however,  we  make  the  following 
observations: 

(i)  For  each  fixed  X,  the  functional 

h, (U(*))  ~ ! X'i(T,T)B(T)u(T)dT 
X °o 

is  lower  semicontinuous  on  IB  (f2)  . 

(ii)  to(Q)  is  weakly  compact  [2,  p.  157], 

As  a consequence  of  (i)  and  (ii) , for  each  fixed  X,  supthx(u(0)  = u<*) 

to  "max"  in  (A. 5)  and  we  have 


is  attained.  Hence,  we  can  change  "sup" 
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r rT 


(A. 6)  j Hn(B' (t)$ ' (T,t)X)<1t  = max|  j X'4 (T,t)B (r)u(T)dT  : u(*)  € (n) - 


(A. 7)  J(x  ,T,X)  = X'§ (T,0)x  + maxi  \ X' (T,t)B (T)u(T)dr  : u(*)  €to  (f))r 


Now,  let  13  be  any  closed  ball  and  define  V : 13  x ul (Q)  -»  R by 


(A. 8)  V(X,u(*))  = X'«(T,0)x  + I \'*(T,T)B(T)u(T)dT 

O V 

o 

We  assume  for  now  that  V(X,u(*))  possesses  at  least  one  saddle  point 
(\^,u^(*))€  13xiU(fl).  (The  existence  of  such  a saddle  point  will  be  proven  in 
Lemma  A. 3 to  follow).  Therefore,  for  all  u(»)€ift(Q)  and  all  >.€3 


(A.  9) 


V(X*,uC))  5 V(X*,u*(0)«7(X,u*(0)  . 


By  hypothesis,  there  is  a T€[0,!°)  and  a set  A containing  0 as  an  interior 


point  such  that 


0 = min{j(x  ,T,X)  : X€A] 
o 


Since  0 is  an  interior  point  of  A,  there  is  a closed  ball  13 '-A  such  that 
0 = min{j(xQ,  t,  X)  : X£J3} 

= mini  max  Fx'§  (T,0)x  + ^ X'5  (T,t)B  (T)u(T)dT  : u €IU  (0)  j : X € Ji  !■ 

I L 0 u J j 


Hence,  V(X*,u  (•))  = 0.  Using  this  in  conjunction  with  (A. 9)  leads  to 


r ^ 

0<X'5(l,0)x  +'  X'5  (T,t)B(t)u.  (T)dT  for  all  X€13 


(A. 10) 


0 £ X'x.(T)  for  all  X€6 


where  x^(*)  is  the  state  response  of  (S)  resulting  from  input  u^(*).  The  only 
way  that  (A. 10)  can  hold  for  all  X€3  is  if  x*(T)  = 0 and  u*(‘)  steers  (S) 


from  x at  t = 0 to  zero  at  time  T. 
o o 


Lenina  A. 3.  V(\,u(*)),  defined  in  (A. 8),  possesses  at  least  one  saddle 

point. 

Proof.  In  accordance  with  Proposition  2.3,  [20,  p.  175],  V(\,u(*))  will 
possess  a saddle  point  if  the  following  conditions  are  satisfied: 

(A. 3.1)  For  all  \€8,  u( • ) - V(\,u( • ) ) is  concave  and  upper  semicontinuous . 
(A.3.2)  For  all  u(*)€ft(fi),  \-V(\,u(*))  is  convex  and  lower  semicontinuous, 

(Note:  We  shall  viewITl(fi)  as  a subset  of  L [0,1,8™]  when  verifying  the  semi- 
continuity requirements.) 

Proof  of  (A. 3.1):  Fix  \€8.  Concavity  of  V(\,*)  follows  trivially  from 

affine  linearity.  We  shall  show  that  V(\,*)  is  continuous.  Let  u^( • ) ~*  ii( • ) 
o 

in  L norm.  Then  using  the  Schwartz  inequality,  we  can  easily  show  that 

r rT  2 T1/2f  '>T  2 ^1/2 

]v(\,unO)  - V(\,u(-))1  *{j  1|x'*(T,t)B(t)||  dTj  ^ \ ||un(T)  -u(T)|!  dTj 

o o 

The  first  term  on  the  right  hand  side  is  finite  since  \'§(T,*)B(‘)  is  continuous. 
The  second  term  converges  to  zero  by  hypothesis.  Hence,  • ) ) - V(\,u( • ) ) 

as  n -♦  00 . 

Proof  of  A.3.2;  Now  fix  u(*)€H\(n).  The  linearity  of  V(*,u(*))  implies 
convexity.  Let  \ -♦  \ in  8.  Then,  we  can  show  that 

lV(Xn,u(.))  - V(\,u(-)|  * K)l\n-\|| 


where 


T 

K = ||4(T,0)xJ|  + ||J  $(T,r)B(T)u(T)dT||  ; K 


Hence,  V(\  ,u(*))  "*  V(\,u(»))  as  n->  «, 
n 


Next,  we  present  the  proof  of  Theorem  2.1.  In  the  proof,  Theorem  2.3 


is  used. 
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Proof  of  Theorem  2.1  (Necessity):  We  suppose  that  (S)  is  globally  Q-null 
controllable  at  tQ  = 0.  Let  z(*)  be  any  non-zero  solution  of  (S')  and  we  must 
prove  that 


r 

(A. 11)  . j H^(B ' (T)z(T))dT  = +« 

o u 

Proceeding  by  contradiction,  suppose  there  is  a non-zero  solution  z (•)  such  that 

D 

H^(B ' (t)z(t ) )dT  = B ; 3 < « 


From  Lemma  A.l,  H^(B ' (T)z(-r))dT  2 0 and  3 2 0.  Suppose  3^0  and  define 

x*  = ; x*  + 0 . 

0 z' (0)z(0)  0 

We  now  claim  that  x*  cannot  be  steered  to  zero  by  an  admissible  input 

o 

\a ( • ) € IU (Q) . To  prove  our  claim,  for  each  t€[0,®),  define 

\ - *' (0,t)z(0)  ; \ ¥ 0 . 

Now 

J(x*,t,X  ) = x*'i' (t,0)\t  + j JLjCB'  (T)S'(t,T)\t)dT 

o 

A f't 

= x*'z(0)  + I IU(B' (T)z(T))dT 

O W 

o 

£ -23  + 3 

< 0 

Taking  A to  be  the  closed  unit  ball  in  Theorem  2.3,  it  now  follows  that  pt\c € A 
for  sufficiently  small  p . We  have 

mini J(x*, t,  X)  : X € A]  i J(x*,t,?tXt) 

< 0 

for  all  t€[0,®).  By  Theorem  2.3,  (S)  is  not  (1-null  controllable  at  (x*,to). 
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Now  suppose  3 = 0.  Then,  for  all  t€Lo,°°), 


j Hn(B'(T)0'(t,T)z(O))dT  = 0 


Choose  any  x such  that  x'z(0)  < 0.  Then 
o o 


J(x  ,t,\  ) = x'z(0)  < 0 
o t o 


for  all  tc[0,“).  Again  by  Theorem  2.3,  (S)  is  not  11-null  controllable  at 

(xo,tQ).  This  contradicts  the  hypothesis  that  (S)  is  globally  H-contro liable. 

(Sufficiency):  Now,  we  assume  that  (A. 11)  holds.  Again,  we  proceed 

by  contradiction,  i.e.,  suppose  (S)  is  not  globally  H-null  controllable  at 

t =0.  Hence,  there  exists  an  initial  condition  x*  # 0 which  cannot  be 
o o 

steered  to  zero.  By  Theorem  2.3  (with  A = Rn) , we  can  find  a sequence  of 

. .CD  00 

times  and  a sequence  of  vectors  having  the  following  properties 

PI.  lim  t = ; 

k-®  * 

P2.  < 0 for  k = 1,2,3... 

We  are  going  to  construct  an  initial  condition  z ^ 0 for  (S')  which  makes  the 

o 

integral  in  (A. 11)  finite.  To  meet  this  end,  let 


'k  " ii*- (ek,0)Xkn 


; k = 1,2, .. . ; zk  # 0 • 


/ \°°  n 

Then  (z  )k_^  is  a sequence  in  R belonging  to  the  set 

S = [z  €Rn  : jj z|i  = 1} 


Since  S is  compact,  we  can  extract  a subsequence  (z,  ) which  converges 

k k =1 

to  some  vector  z cS,  We  will  now  show  that  z is  the  initial  condition 
o o 

which  we  seek.  Let  z(-)  be  the  trajectory  of  (S’)  generated  by  z(0)  * zq;  let 


. 


r J 

Hq(B'  (t)S'  (0,T)zk  )dT  S ||x*||  ||zk  ||  for  k = 1,2,3,... 

°o  j j J 

£ IMI  for  k.  = 1,2,3,... 
n 0,i  j 

We  would  like  to  obtain  an  inequality  involving  zq  with  an  infinite  upper 
limit  on  this  integral.  To  accomplish  this,  we  define 

fk  (T)  = Ha(B'  (T)*'  (0,T)zk  ) if  T€C0,tkJ  ; 

j j j 

= 0 otherwise 

f(T)  = Ha(B'  (T)i'  (0,T)zo)  ; t€[0,») 

and  make  the  following  observations: 


(i)  j f (T)dT  is  bounded  (by  ||x*||)  for  k.  = 1,2,3,... 

o ° J 

(ii)  fk  (T)  converges  pointwise  to  f(T)  on  [0,®).  This  observation 

J 

is  proven  using  the  facts  that  zk  — z^,  tk  — +00  and  depends 


i 


continuously  on  its  argument. 
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Applying  Fatou's  Lemma  [21,  p.  83],  we  have 

„co  n<a 

f(T)dT  S lim  inf  j f,  (T)dT 
"o  k - “ o ki 

j 


r 

£ lim  sup  ! f (T)dT 

k . ■*  ® **  o j 

J J 


* ilx*!1 


Substitution  for  f(T)  above  gives 


j H^B'  (T)S'  (0,T)zQ)dT  * ||X 


Hq(B'  (T)z(T))dT  £ II X 


which  is  the  contradiction  that  we  seek.  This  completes  the  proof  of  the 
theorem.  L 

Proof  of  Corollary  2.2.  Suppose  Q and  Q'  satisfy  the  hypotheses  of  the 
corollary.  We  are  going  to  show  that  (S)  is  globally  Q'-null  controllable. 

To  prove  this,  it  is  sufficient  to  find  a subset  such  that  (S)  is 

globally  f^-null  controllable:  Pick  6 > 0 such  that 

Ci'b  = [iu  : ilioil  s 6]  c Cl' 

(This  can  be  accomplished  because  zero  is  interior  to  f*.)  Now,  to  prove  that 
has  the  desired  property,  we  pick  R > 0 such  that 

^ = («  : ||uu||  5 r}  3 Q 

(This  can  also  be  done  since  Q is  compact,  hence  bounded.)  Let  z(-)  be  any 


I 
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non-zero  solution  of  (S').  Then  we  have 


j HQ1  (B*  (T)z(r))dT  = \ supiui'B'  (t)z(t)  : ||(u||  s 5] 
o 5 o 


c00 

= 6 j ||  B ' (T)z(T)||dT 


| j R||b'  (T)z(T)||dT 


- j supitu'B'  (T)z(T)  : ||uu||  £ R } dT 
o 


I i (B* (T)z(T))dT 

"o  R 


since  (S)  is  globally  Q^-null  controllable.  (Q^-null  controllability  follows 
from  Q-null  controllability  in  conjunction  with  the  fact  that  ^ fj. ) By 
Theorem  2.1,  we  conclude  that  (S)  must  be  globally  w^-null  controllable  and 


hence  fl'-null  controllable. 
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Proof  of  Proposition  3.3.  (Necessity):  Suppose  (S)  is  globally  R -null 
controllable.  Then  there  is  a finite  interval  [0,T]  on  which  the  rows  of 
0(O,*)B(*)  are  linearly  independent.  Thus,  for  every  non-zero  vector  z^R11, 
it  follows  that  B' (t)0 1 (0, t) z f 0 for  some  t€[0,T].  Since,  B 1 ( • )0 ' (0 , • ) zq 
is  continuous,  there  must  be  an  interval  I = [t-o,t  + 6]  on  which  B 1 (T)0  ' (0 , T)  z^  f 0 
for  all  t£1.  On  this  interval,  we  have 

sup[u)'B'  (t)0'(O,t)z  : uj  € ftm}  = +" 

Hence,  using  the  non-negativity  of  Hq(-)>  we  conclude  that 


H (B ' (T)z(T))dT  2 H (B ' (t)0' (0,T)z  )dT 
% Rm  -!  Rm 


SUploi'B'  (T)0'  (0,T)ZQ)dT 


(Sufficiency):  Proceeding  by  contradiction,  we  suppose  that  for  all  non-zero 

solutions  z(»)  of  (S'),  we  have 


H (B' (T)z(T))dT  = +® 
o Rm 

but  the  columns  of  B ' ( * )0 ' (0 , • ) are  linearly  dependent  on  every  bounded  interval 

CO 

lO.Tj.  Let  (T  ) , be  a monotone  increasing  sequence  of  times  such  that 

n n=l 

T — ®,  Then,  for  each  n,  we  can  find  a non-zero  vector  z such  that 
n n 

B’ (T)0>  (0,T)z  a o on  [0,T  ].  Let 
n n 


A Zn 


for  n * 1,2 


w 
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Then,  (z  ) is  sequence  in  the  (compact)  unit  ball.  Hence,  we  can  extract 
n n=l 

a subsequence  z converging  to  some  z , ||z  j|  = 1.  We  notice  that  the  corre- 

j 

sponding  subsequence  of  times  T still  converges  to  + “.  Furthermore,  for 

j 

each  fixed  t€[0,®),  we  have 

B' (T)0' (0,t)z  = lim  B' (T)0' (0,T)z 

o _ n . 

a.  j 

j 


Consequently,  if  z(t)  is  the  trajectory  mate  of  z^. 


1 H (B ' (T)z(T)  )dT  = supiuj'  B'  (T)0'  (0,T)Z  lOjSR^jdT 
_m  o o 

o R o 


which  contradicts  the  assumed  hypothesis. 
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Proof  of  Lemma  4. L.  For  (x  ,T)  fixed,  J(x  ,T,\)  can  be  expressed  as 

o o r 

J(xQ,T,\)  = suplH^X)  : (!>(•)  6IU(Q)} 


where 


a r1- 

H (X)  = X'9(T,0)x  + | X'«(T,T)B(T)a>(T)dT 

o 

Consequently,  J(xq,T,*)  is  the  pointwise  supremum  over  an  indexed  collection 
of  continuous  linear  (hence  convex)  functions.  Hence  J(xq,T,*)  itself  must 
be  convex  and  at  least  lower  semicontinuous  (in  fact,  continuous).  I 


Proof  of  Lemma  4.2.  We  prove  this  lemma  using  some  of  the  standard  prop- 
erties of  subdifferentials  given  in  Rockafellar  [22],  ]23l.  Since  both  functions 

in  the  definition  of  J(x  ,T,X)  are  finite  and  convex  X.  £Sj(x  ,T,X)  if  and 

o * o 

only  if 


X 6a(x'S'  (T,0)  X) 

* O 


+ 3 j H^(B!  (T)S'  (T,T)\)dT 

u 


(Dy  Theorem  23.8  of  [23]) 


r j 

= 9(T,0)x  + ; aiU(B' (T)9'(T,T)X)dT  (by  Theorem  23  of  [23]) 

O o i L 


= 9(T,0)x  +!  9(T,T)B(T).aH-(j)(T))  « 

O *j  \L 

O 


*i(T)=B' (T)4' (T,T)XdT 

(by  Theorem  23.9  of  [22]) 


Now,  by  Corollary  23.5.3  of  [22],  u>*(T)  £aiU(u)(T))  if  and  only  if  uu*(T)  6 
arg  maxtu)'u)(T)  : oj€Q}.  Substituting  the  required  form  for  i above,  we  obtain 
our  desired  representation  for  X . □ 


>; 


« 


Proof  of  Theorem  5.1.  Let  f : L1(0,T;Rm)  - Rn,  g : Rn  - R,  A : L^O.TjR1")  - Rn 
be  given  by 

f(u)  = 0 if  u(*)  S ni (0)  ; f(u)  = +®  otherwise  ; 
g(z)  = -l|i(T,0)Xo  + z\\  ; z€Rn  ; 

Atu  = j 9(T,T)B(T)u(T)dT  . 
o 

Then,  using  the  notation  above 

inf(MN)  = inf{j|x(T)||  : u(*) 

= inf{f(u)-g(ATu):u€L1(0,T;Rm)} 

Written  in  this  way,  inf(MN)  is  in  the  standard  form  for  application  of 
Rockafellar ' s extension  of  Fenchel’s  Duality  Theorem  (cf.  [24],  Theorem  1). 

The  functionals  f and  g are  respectively  proper  convex  and  concave  functions; 
it  can  be  easily  shown  that  inf(MN)  is  "stably  set"  --  a technical  precondition 
for  Rockafe liar 1 s Theorem. 

By  carrying  out  the  computations  involved  in  Theorem  1 of  [24],  it  can 
be  shown  that  the  problem 

min(MN)  = min[j(x  ,T,\)  : X 6 a} 
o 

is  dual  to  inf(MN)  in  the  following  sense: 

inf(MN)  + min(MN)*  = 0 

The  "extremality  condition"  in  Rockafellar ' s theorem  provides  a necessary 
condition  which  must  be  satisfied  by  all  solution  pairs  solving  (MN)  and 
u*(»)  solving  (MN) . The  extremality  condition  requires 


A$v*6a£<u*> 

where  A*  is  the  adjoint  of  A^  and  df(u^)  is  the  subdifferential  of  f at 
For  our  choice  of  f,  this  necessary  condition  particularizes  to 

\;i(T,T)B(T)  € (Normal  cone  of  IA(Q)  at  u^(-)) 


We  denote  this  normal  cone  at  u^  by  N^Cu^).  By  definition  of  the  normal  cone, 

we  have  v(-)  €n  (u*)  if  and  only  if 
c 

rT  rT 

j U^(T)B'  (t)$  ' (T,T)  \^dT  = j suplu)'  B'  (T)i  ' (T,t)  : u)  € Q}dT 


This  is  possible  only  if  u>  = u (t)  achieves  the  supremum  of  tu' B' (t) 5 ' (T, t) 
for  almost  all  t£[0,T].  Equivalently,  we  must  have 

u^(t)  € arg  max iiu'  B ' (T)  i ’ (T,  T)  : oj  € Cl} 

for  almost  all  t€[0,TJ. 
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Summary 

1.  Introduction  and  Formulation.  Unlike  the  usual  control- 
lability problem  where  control  values  at  each  instant  of  time 
are  unconstrained,  we  consider  here  the  case  which  arises 
when  the  control  values  at  each  instant  belong  to  a prescribed 
set  ft  in  Rm.  Constrained  controllability  problems,  for  linear 
systems,  are  examined  in  References  [1  ] - [5].  In  this  paper, 
our  definition  of  local  constrained  controllability  is 
identical  to  that  of  Brammer  [1].  Our  new  results,  however, 
generalize  those  of  [1]  from  a time- invariant  to  a time-varying 
linear  system.  The  main  results  here  serve  as  a companion 
for  those  of  [6]  and  [7]  where  global  rather  than  local 
controllability  is  emphasized. 

Consider  the  problem  of  steering  the  state  of  a linear 
system 

x(t)  = A ( t ) x ( t)  + B ( t)  u ( t ) ; te[t0,°°)  (S) 

to  the  origin  from  a specified  initial  condition 


by  choice  of  control  function  u(*).  Here  x(t)eRn,  u(t)eRm 
and  A ( • ) and  B(*)  are  continuous  matrices  of  appropriate 
dimension.  Let  M(ft)  denote  the  set  of  functions  from  R into 
ft  that  are  measurable  on  Ct^,®). 

2.  Definition.  The  linear  system  (S)  is  constrained 
controllable  (ft  - null  controllable)  at  (x0,tQ)  if  for  given 
initial  condition  x(tQ)  = XQ/  there  exists  a u(*)eM(ft)  such 


L ;J . , — . ^ 


H 


that  the  solution  x(*)  of  (S)  satisfies  x(T)  =0  for  some 
TeCtg,®).  We  say  that  (S)  is  locally  n - null  controllable 
at  tp  if  there  exists  an  open  set  VcRn,  containing  the  origin, 
such  that  (S)  is  Q - null  controllable  at  (x0,tQ)  for  all 

Vv- 

3.  Notation.  Our  necessary  and  sufficient  condition  for 
local  71  - null  controllability  will  be  expressed  in  terms  of 
A(*),  B ( • ) and  H^:Rm-^R,  the  support  function  on  71,  which  is 
given  by 

A 

H^(a)  = sup{(ii' a rcoefl} 

for  aeRm.  We  need  some  further  notation:  Suppose  f(*)  is 
an  n-dimensional  continuous  function  on  [tQfoo)  such  that  f(0)^  0. 
Then  f*(*)  will  denote  the  normalized  version  of  f ( • ) which 
is  given  by 

« a f(t) 

f*(t)  = I|  fToTU 

for  te[t0,oo).  in  the  theorem  to  follow,  the  adjoint  system 
z(t)  = -A' (t)z(t);  te[t0,°°) 

will  be  denoted  by  (S')  and  <}>(t,T)  will  be  the  state  transi- 
tion matrix  for  (S)  . 


4.  Theorem.  Suppose  71  is  compact  and  contains  zero.  Then 
(S)  is  locally  Q - null  controllable  at^  tQ  i£  and  only  if 
there  exists  an  e>0  such  that 


Consequently,  we  can  immediately  conclude  (from  the  theorem) 
that  (S)  is  locally  ft-null  controllable  if  and  only  if  (S) 
is  locally  ft' -null  controllable. 

(iv)  In  the  paper,  we  examine  some  interesting  special 
cases  which  arise  when  ft  is  endowed  with  additional  structure 
(over  and  above  "0 eft"  and  "ft  compact") . 
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Abstract 

In  this  paper  we  survey  some  of  our  recent  results  [1,2]  on  the  con- 
trollability of  linear  systems  when  there  are  magnitude  constraints  on  the 
control. 


1.  Introduction 


Consider  the  problem  of  steering  the  state  of  a linear  system 

x(t)  = A(t)x(t)  + B(t)u(t)  ; t € [t  ,») 

o 

to  the  origin  from  a specified  initial  condition 

x ( t ) = x 
o o 

by  choice  of  control  function  u(-).  Here  x(t)  6 Rn,  u(t)  € Rm  and  A(*)  and  B(*) 
are  continuous  matrices  of  appropriate  dimension.  Unlike  the  usual  control- 
lability problem  where  the  control  values  at  each  instant  of  time  are  unconstrained, 
we  insist  here  that  the  control  values  at  each  instant  belong  to  a prescribed 
set  Q in  R . 

Let  m (Q)  denote  the  set  of  functions  from  R into  ft  that  are  measurable  on 
CtQ,») . Then  any  control  u(*)  €Ih(ft)  is  termed  admissible.  We  now  define  the 
concept  of  constrained  controllability  or,  more  precisely,  Cl-null  controllability. 

Definition  1.  The  linear  system  (S)  is  constrained  controllable  at  (x  .t  ) (ft-null 
o o 

controllable  at  (x  ,t  ) if  for  given  initial  condition  x(t  ) = x there  exists  a 
o o ° o o 

u(*)  fv  ' such  that  the  solution  x(*)  of  (S)  satisfies  x(T)  = 0 for  some 
T6[t 

o 


Definition  2,  (S)  is  completely  constrained  controllable  at  tQ  (globally  ft-null 

controllable  at  t ) if  (S)  is  ft-null  controllable  at  (x  , t ) for  all  x €Rn. 
o_  o o o 

A simple  example  illustrates  that  a system  may  be  controllable  if  the  control 

values  are  unconstrained  but  not  if  they  are  constrained.  Let  x(t)  and  u(t)  be 

scalars  and  x(t)  = x(t)  + u(t),  x(0)  = x . If  there  are  no  constraints  on 

o 

u(*)(Cl  = R) , the  system  is  completely  controllable.  However,  if  Q = £ou  : } a>]  £ a), 
then  for  xq  ^ a it  is  not  possible  to  drive  the  system  to  the  origin  with  a 
control  satisfying  u(t)  6 fi. 


1 


n 


r~? 

t 


r 


r~ 


_ 


2 


In  the  next  section,  we  present  a necessary  and  sufficient  condition  for 

(S)  to  be  constrained  controllable  at  (xo,tQ)  and  a necessary  and  sufficient 

condition  for  complete  constrained  controllability  at  tQ.  Unlike  much  of  the 

work  of  previous  authors  £3-8],  out  results  concentrate  on  the  case  where  the 

matrices  A(‘)  and  B(*)  are  time-varying  rather  than  constant  matrices.  Our 

conditions  for  global  Q-null  controllability  require  that  ft  be  compact  and 

contain  zero,  but  not  that  zero  be  an  interior  point.  Furthermore,  in  the 

case  of  Q-null  controllability  at  (x  ,t  ),  we  need  not  assume  that  there 

o o 

exists  a u S Cl  such  that  Bu  = 0. 


2.  Necessary  and  Sufficient  Conditions 
First  we  present  a necessary  and  sufficient  condition  for  fl-null  con- 
trollability at  (xo,tQ).  To  this  end,  define  the  scalar  function 

r*T 

J : Rn  x R x Rn  - R by  J(x  ,T,\)  = x^0  ' (T,  tQ)  \ + j supj>'B'  (T)0'  (T,t)X  ; ui  £ fl}dT 

o 

where  0(t,T)  is  the  state  transition  matrix  for  (S) . 


Theorem  1.  [Ref,  l].  Let  fl  be  compact  and  suppose  A is  any  subset  of  Rn  which 

contains  0 as  an  interior  point.  Then  (S)  is  Q-null  controllable  at  (x  ,t  ) 
o o 

if  and  only  if 

min  [j(x  ,T, X)  : X € A}  = 0 
o 

for  some  T 6 [t  , °°) . 

o 

This  theorem  demonstrates  that  the  question  of  constrained  controllability 

can  be  answered  by  solving  a finite  dimensional  optimization  problem.  Moreover, 

the  system  is  globally  Q-null  controllable  at  tQ  if,  and  only  if,  for  every 

x 6 Rn  there  is  a T < * (which  may  depend  on  x ) such  that  min[j(x  ,T,X)  : X € A]  = 0. 
o o o 

However,  checking  for  global  Q-null  controllability  this  way  can  be  quite  tedious. 

A simpler  technique  is  embodied  in  the  following  theorem. 


Taking  A = [\  ; [ \J  s l}  in  Theorem  1,  it  follows  that  the  minimum  of  J(xq,T,X) 


will  be  zero  if  and  only  if 


-a(l  - e)T  S x * a(l  - e'T) 
o 


and  the  system  is  ft-null  controllable  if  and  only  if  jx^j  < a. 
If  the  system  equation  is  x(t)  = -x(t)  + u(t),  then 


, supim'B' (T)z(t)  :u)€Cl}  = a|eTz  |dT 

u o 


Since  this  integral  is  + “ for  all  zq  ^ 0,  the  system  is  globally  fJ-null 


controllable. 


L. 


3.  Local  Controllability 

One  other  concept  of  controllability  is  that  of  local  controllability. 


Definition  3.  (S)  is  locally  G-null  controllable  at  t if  there  exists  an 


open  set  V1— Rn,  containing  the  origin,  such  that  (S)  is  G-null  controllable 


at  (x  ,t  ) for  all  x €v. 
o o o 


In  the  next  theorem,  normalized  solutions  z^(*)  of  z(-)  are  needed.  Such 
a solution  is  defined  by 


(t)  £ -z(t) 

f(  } iiz(O)  j 


Theorem  3.  [Ref.  2].  Suppose  G is  compact  and  contains  zero.  Then  (S)  is 


locally  G-null  controllable  at  tQ  if  and  only  if  there  exists  an  e > 0 such 


that 


sup[u)'  B'  (T)z  (T)  : ui  6 G]dT  z e 


for  all  normalized  non-trivial  solutions  z*(*)  of  (S'). 


As  an  example,  consider  the  scalar  system  x(t)  = tx(t)  + u(t) , G = 
For  this  system, 


[-1,1]. 


-T2/2, 


J 


[ supiV  B(T)z^(T)  :u)€G}dT  = ; sup  w e iiz(0)'^°^ 


O ID  SI 


dT 


00  2 

r -tV2.  / n 

= J e dT  = . 2 

o 


Thus  the  system  is  locally  G-null  controllable  but  not  globally  G-nv.ll  con- 
trollable . 


4.  Concluding  Remarks 


The  above  theorems  can  be  used  to  determine  if  (S)  is  G-null  controllable. 
However,  they  do  not  give  a method  for  determining  a control  which  steers  (S)  to 


5 


the  origin.  One  method  of  determining  a steering  control  is  to  solve  the  time 

optimal  problem  of  finding  u (•)  €IU(w)  which  steers  (S)  from  given  (x  , t ) 

oo 

to  the  origin  in  minimum  time.  If  there  is  a control  which  steers  the  system 
to  the  origin  then  there  is  a time  optimal  one  [3].  Hence,  the  algorithms 
available  for  solution  of  the  time  optimal  problems  can  be  used  to  compute  a 
steering  control. 

Another  technique  which  involves  simpler  computations  and  leads  to  a 
control  which  steers  the  system  arbitrarily  close  to  the  origin  is  based  on  a 
minimum  norm  optimal  control  problem.  Full  details  are  given  in  Cl]. 
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A General  Sufficiency  Theorem  for  Minmax  Control^ 

2 

W.  SCHMITENDORF 

Abstract.  This  paper  considers  optimal  control  problems  where  there  is 
uncertainty  in  the  differential  equations  describing  the  system.  A minmax 
optimality  criterion  is  used  and  sufficient  conditions  for  a control  to  be 
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1.  Introduction.  Sufficient  conditions  for  a control  to  be  a minmax 
control  have  been  presented  in  Refs.  1-2.  Here  we  present  a more  general  suf- 
ficiency result,  Theorem  3.1,  and  also  show  that  the  sufficient  conditions  of 
Refs.  1-2  are  just  special  cases  of  this  new  set  of  conditions.  Theorem  3.1 
applies  to  problems  with  more  general  terminal  conditions  and  cost  functions 
than  does  Ref.  2 and  can  be  used  to  verify  that  a control  is  a minmax  control 
for  some  problem  where  the  results  of  Refs . 1-2  fail  to  yield  any  information. 

2.  Problem  Formulation.  Consider  the  differential  system 

x(t)  = f(x(t),u(t),v(t))  (1) 

where  the  state  x(t)SRn,  control  variables  u(t)  € R and  the  disturbance  v(t)  6 R . 

1 n ml  m2 

We  assume  f (•,*,•)  is  C on  R.  x R xR  . The  playing  space  is  denoted  by  X x T. 

X is  an  open  set  in  Rn  and  T = [t  ,t  ] where  t and  tc  are  specified.  At  t 

o f o r o 

the  initial  state  xq  is  specified.  At  the  final  time,  we  require  x(t^)€6, 
where  the  target  set  9 is  a given  set  in  the  closure  of  X. 

ml 

Let  U denote  the  set  of  piecewise  continuous  functions  from  T into  R 

ml 

and  let  U be  a given  subset  of  R . Define 

ft  ^ = [u(  * ) : u( • ) € U and  u(t)  6 U,  t € Tl 
m2 

Let  V be  a given  subset  of  R and  let  If  denote  the  set  of  piecewise 
continuous  functions  q(*,*)  : T**  V with  respect  to  some  decomposition  of 

X x T. 1 Define 

ft  2 = [q(*  ,*)  : q(- ,*)  <=1/  and  q(x,t)€V  for  all  (x.tjeXxT1 

For  a given  pair  [u(*)  ,q(* , •)] , u(»)£ft^  and  q(*,*)€ft2>  a solution  of 
(1)  from  (xo,tQ)  will  be  denoted  by  x(*)  and  called  a trajectory.  A terminating 
trajectory  is  a trajectory  satisfying  x(t)  6 X for  all  t€[tQ,tf]  and  x(t^)  60.  A 
pair  [u(*) , q ( • , •)]  is  playable  at  (x0>t0)  if  it  generates  a terminating  trajectory. 


^ e.g.,  see  page  42  of  [3]. 
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The  pair  [u( • ) , q(* , • )]  may  generate  more  than  one  terminating  trajectory  from 

(x  ,t  ) and  5 (u( • ) ,q( • , • ) ) will  denote  the  set  of  all  such  trajectories, 
oo 

For  u(*)€tl\^,  lT(u(«))  is  the  set  of  all  q ( « , • ) €TT\  2 such  that  [u(  • ) , q(  • , • )] 
is  playable  at  ( Xq  , tQ ) . We  shall  say  that  u(’)  is  admissible  if  u(«)  €IT. ^ and 

n(u(*))  + 0. 

For  playable  pair  [u( •) , q( • , • )]  and  trajectory  x( •) £ 5 (u( • ) , q( • , •))  the 
cost  is  defined  by 

N rtf 

J (u(  • ) , q( • > * ) ,x( • ) ) = g(x(tf))  + t L(x(t) ,u(t) ,q(x(t) ,t))dt  (2) 

o 

For  an  admissible  u(-),  (q(  • , • ) ,x(* ) ) € K(u(* ) ) iff  q(  • , • ) €il  (u(- ) ) and 
x( • ) € 5 (u( • ) , q( • , • ) ) . We  now  define  a minmax  control. 

JL 

Definition  2.1.  Let  u (•)  be  admissible.  Then  u (•)  is  a minmax  control  iff 

sup  * J(u*( • ) , q( • , • ) ,x(* ) ) 

(q(-,0,x(.))6X(u  (•)) 

s sup  J(u(‘)>q(*»*)»3C(*)) 

(q(*. •),*(•))  €K(u(.)) 

for  all  admissible  u(*). 

3.  A Sufficient  Condition.  Before  presenting  a sufficient  condition  for  a 
minmax  strategy,  some  additional  nomenclature  is  needed.  The  set  £(u(*))  is 
defined  by 

£(«<•))  « {Cq(',0,*(-)]€X(u(.))  : J(u(0,q(*, •),*(•)) 

s J(u(.),rC,*),y('))  for  all  [r  ( • , • ) ,y(  • )]  € K (u(  • ) )} 


The  set£(u(.))  consists  of  the  disturbances  and  corresponding  trajectories 


which  maximize  the  cost  when  Player  1 uses  u(*). 

In  the  case  where  v(»)  is  not  present  in  (1)  or  (2)  we  have  the  usual  optimal 
control  problem.  Then  we  say  that  u (*>€1^  is  an  optimal  control  iff  it 
generates  a terminating  trajectory  x (•)  and 
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J(u*(«)»x*(0)  ^ J (u (•)  > x ( • ) ) 

for  all  u ( • ) € m ^ that  generate  terminating  trajectories. 

Let  z ( • , • , •)  be  a function  from  XxTxU  •*  V and , for  u(*)  q^  ( • , • ) 

is  the  function  defined  by  q^CXjt)  = z(x,t,u(t)).  Such  a function  z(*,»,*) 
will  be  called  a response  function.  The  set  of  admissible  response  functions  is 

Z = { z( *,*,•) 1 q^(* ,*)  €Tl (u( •) ) for  all  admissible  u(*)^ 

For  positive  integer  y,  scalars  > 0,  i - l,***,y  and  functions  z1  (•,•,•)  €Z , 
i = l,««*,y  we  define  an  optimal  control  problem  P(Y,Qr^,  • • • ,a  , z^  (• , •»•),••• , 

v 

z (•»•»•))•  This  problem  has  state  equations 

xx(t)  = f(x1(t) ,u(t) ,z1(x(t) ,t,u(t))  ; x1 (tQ)  = xqJ  i = v 


and  cost 

J(u(.),x1(.),--*,xY(-))  -2.  O'  J(u(»),qi(*,*),x1(.)) 

1=1  1 u 

Here  q^(x,t)  = z1 (x, t ,u(t) ) . The  terminal  conditions  are  xX(t^)  €9,  i * l,-.-,y. 

We  now  present  a sufficient  condition  for  a control  to  be  a minmax  control. 

“/c 

Theorem  3.1.  Let  u (•)  be  admissible.  Then  u (•)  is  a minmax  control  if  there 
exists 

i)  a positive  integer  y 

ii)  scalars  or  > 0,  i = l,***,y 

iii)  admissible  responses  z1  (♦,»,•) , i = l,»*«,y 


such  that 
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a)  u (•)  is  an  optimal  control  for  the  problem  P(v,ar  ^ • .or^,  z (•,*,•)» 


,zY(* . • » •)) 


b)  for  i = 1,  • • • ,y,  [q^*(‘,*),x  (*)3€I(u  (•))  where  q^(x,t)  = z^x.t.u  (t)) 

i* 

and  x (•)  is  the  solution  of 


x (t)  = f ( x ( t ) , u (t),q^(x  (t),t)),  x1(tQ) 


■7S.:: 
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4.  Discussion.  Condition  (a)  of  Theorem  3.1  requires  u (•)  to  be  the  solution 
of  an  optimal  control  problem.  Two  approaches  are  available  for  verifying  that 
a control  is  an  optimal  one:  (i)  the  field  theorem  approach  (see,  for  example, 
Refs.  4-5)  and  (ii)  the  direct  sufficient  condition  approach  (see,  for  example, 
Refs.  6-7). 

If  the  final  time  is  specified,  the  final  state  is  free  and  g(.)  is  convex, 
the  direct  sufficiency  approach  can  be  used  to  establish  (a)  of  Theorem  3.1. 

This  leads  directly  to  the  sufficient  condition  of  Ref.  2 and  the  result  presented 
there  is  just  a corollary  of  Theorem  3.1.  A direct  sufficient  condition  for 
problems  with  more  general  terminal  conditions  is  available  in  Ref.  8 and  it 
can  also  be  used  to  verify  (a) . 

While  the  direct  sufficient  conditions  are  relatively  easy  to  apply,  they 
are  limited  in  application  since  they  may  yield  no  information.  A more  powerful 
technique  is  the  field  theorem  approach  and  it  can  be  used  to  establish  (a) 
of  Theorem  3.1.  When  v = 1 and  the  field  theorem  approach  is  used  to  verify 
(a),  Theorem  3.1  becomes  Theorem  4.1  of  Ref.  1 and  that  theorem  is  also  just 
a corollary  of  Theorem  3.1.  However,  Theorem  3.1  is  more  general  than  the 
theorem  in  Ref.  1 since  it  is  not  restricted  to  y = 1.  In  using  the  field 
theorem  approach,  h(x,u,t)  = f (x,u,z(x,t,u) ,t)  may  not  be  C*'  and  the  usual 
assumption  of  the  field  theorem  is  not  met.  In  this  case  the  more  general 
field  theorem  of  Ref.  9 can  be  used.  There  h( •,',•)  is  not  required  to  be  C^. 

5.  Concluding  Remarks  It  has  been  shown  that  the  problem  of  verifying  that 

a control  is  a minmax  control  can  be  accomplished  by  establishing  that  certain 

functions  satisfy  related  ordinary  optimal  control  problems.  In  particular, 

★ 1 
u (•)  is  a minmax  control  if  it  is  an  optimal  solution  of  P(v,Q'^ ,0*^,2  (*,*,•)  , 

Y i 

•••,z  (•,*,•))  and  if  qu*('i*)  is  a solution  of  the  optimal  control  problem 


control  theory  can  be  used  on  these  optimal  control  problems.  Previous  suf- 
ficient conditions  for  minmax  control  are  just  corollaries  of  this  general 
result  given  here. 

A comment  on  feedback  minmax  strategies  is  appropriate.  In  Ref.  1,  a 
sufficient  condition  for  a minmax  feedback  strategy  is  given  as  well  as  the 
sufficient  condition  for  an  open  minmax  control.  Attempts  to  extend  Theorem  3.1 
so  that  it  applies  to  feedback  minmax  problems  have  been  unsuccessful.  The 
reason  for  this  is  that  the  feedback  solution  to  the  problem  P (7,0^  , • • • ,a  , 


z (•  i •>•)>*".  z (•>•>*) ) will  depend  on  x (•)»  i = 1,***,'Y.  But  the  x (•)  are 
artificial  variables  and  do  not  have  any  physical  meaning.  There  is  no  way  to 


implement  a control  based  on  the  x^  and  a feedback  control  dependent  on  the  x1 


is  meaningless. 

Also,  the  theorem  does  not  apply  to  problems  where  the  final  time  is 
unspecified.  In  such  a case,  each  trajectory  x1(.)>  i = 1,2, •••,>/,  might 


reach  the  target  9 at  different  times  and  ^ ,••• ,a ,zL (•>•»•)»••• >zY( ) 


can  not  be  treated  by  standard. optimal  control  theory. 


1 
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APPENDIX  E 


AFOSR-TR-  V 3-15  36 

Optimal  Control  of  Systems  with  Multiple 
Criteria  When  Disturbances  are  Present 


W.  SCHMITENDORF2 


Abstract.  Optimal  control  problems  with  a vector  performance  index  and 
uncertainty  in  the  state  equations  are  investigated.  Nature  chooses  the 
uncertainty,  subject  to  magnitude  bounds.  For  these  problems  a definition 
of  optimality  is  presented.  This  definition  reduces  to  that  of  a minmax 
control  in  the  case  of  a scalar  cost  and  to  Pareto  optimality  when  there  is 
no  uncertainty  or  disturbance  present.  Sufficient  conditions  for  a control 
to  satisfy  this  definition  of  optimality  are  derived.  These  conditions 
are  in  terms  of  a related  two-player  zero-sum  differential  game  and 
suggest  a technique  for  determining  the  optimal  control.  The  results  are 
illustrated  with  an  example. 

Key  Words : Differential  games,  Pareto-optimality,  multicriteria  optimization, 
control  theory. 
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1.  Introduction.  In  the  standard  optimal  control  problem,  the  system  to  be 


controlled  is  modelled  by  ordinary  differential  equations,  the  cost  is  a 
scalar  and  one  player  selects  the  control.  Isaacs  (Ref.  1)  introduced 
conflict  into  the  situation  with  the  addition  of  a second  player  who  chooses 
his  controls  to  maximize  the  criterion  that  the  first  player  want  to  minimize. 
This  led  to  two  player  zero-sum  differential  game  theory. 

One  application  of  this  theory  is  to  optimal  control  problems  where  dis- 
turbances are  present  in  the  differential  equation  model  of  the  system.  In 
such  problems,  it  is  assumed  that  nature  can  choose  the  disturbance  or 
uncertainty,  subject  to  magnitude  constraints.  Then,  given  any  control, 
there  is  a guaranteed  upper  value  to  the  cost  and  the  objective  is  to  choose 
a control  which  gives  the  lowest  guaranteed  cost.  A control  design  based 
on  this  philosophy  is  termed  a worst  case  design. 

Looking  at  nature  as  a second  player  this  formulation  le-^ds  to  a two 
player  zero-sum  differential  game.  If  this  game  has  a saddle  point  solution 
(and  certain  playability  assumptions  are  satisfied),  then  the  corresponding 
control  gives  the  lowest  guaranteed  cost.  Often,  however,  there  will  not 
exist  a saddle  point  solution  for  the  resulting  differential  game  and  the 
theory  of  Ref.  1 cannot  be  used.  Some  results,  in  the  form  of  sufficient 
conditions,  are  available  for  determining  controls  which  result  in  the 
lowest  guaranteed  cost  (Ref.  2-3). 

Another  extension  of  the  work  of  Ref.  1 has  been  to  multicriteria  opti- 
mization problem.  In  these  problems,  there  are  many  players,  each  having 
his  own  performance  index.  The  players  may  not  be  in  direct  conflict  and 
may,  in  fact,  be  willing  to  cooperate. 
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Here  we  treat  multicriteria  optimal  control  problems  where  there  is 
uncertainty  in  the  state  equations.  An  optimality  criterion  is  defined  and 
then  sufficient  conditions  for  an  optimal  control  are  derived.  In  addition, 
it  is  shown  how  these  results  may  be  used  to  determine  an  optimal  solution. 

2.  Problem  Formulation.  Consider  a control  system  described  by  the  differ- 
ential equations 

x(t)  = f (x(t) ,u(t) ,v(t) ) (1) 


where  x(t)  €r  is  the  state,  u(t)  6 R ^ is  the  control  and  v(t)  6 R “ is  the 
disturbance.  We  assume  that  f (♦,*,•)  is  a C1  function.  The  time  interval 
[tQ,tf]  is  specified  as  is  the  initial  state 


x(to)  = XQ  (2) 

The  disturbance  v(*)  is  not  known  exactly;  the  only  information  available 

m2 

about  v(*)  is  that  v(t)  belongs  to  a known  set  VCR  . Rather  than  modelling 
the  system  in  a stochastic  manner,  we  assume  nature  can  choose  any  disturbance, 
subject  only  to  v(*)  being  piecewise  continuous  and  v(t)  £v. 

Let 

M-^  = {u(. ) : u(* ) 6 U and  u(t)  6 U , t € [tQ,  tf  j] 

ml 

where  U is  the  set  of  piecewise  continuous  functions  from  [t  , tfJ  - R L and 

ml  ° 

U is  a given  subset  of  R . Similarly,  let 

m2  = ^v(")  : v(*)  €lr  and  v(t)  € V , t € [tQ,tf]} 

m2 

where  U is  the  set  of  piecewise  continuous  functions  from  [t  , t,]  - R . 

o r 

For  u ( • ) and  v(-)  €m2>  the  solution  of  (1),  (2)  will  be  denoted  by  x(.). 
The  pair  [u(*)>v(*)J  is  playable  if  it  generates  a solution  of  (1),  (2) 
such  that  x(tf)  €6  where  the  target  set  6 is  a given  set  in  Rn. 
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For  u ( • ) N(u( • ) ) is  the  set  of  all  v(*)  6 M2  such  that  [u(*),v(*)] 

is  playable.  A control  u(*)  is  admissible  if  u(*)  €m^  and  N(u(*))  # 0. 

V 

For  a playable  pair  [u(*),v(*)],  the  cost  is  a vector  with  two  components, 


t 

r* 


f 


^(uCO.vO))  = gi(x(tf))  + J L.(x(t),u(t),v(t))dt  , i - 1,2  (3) 

o 

Here  x(*)  denotes  the  trajectory  corresponding  to  u(*),v(*)  starting  at 
(xq, tQ) . (The  results  presented  below  can  easily  be  extended  to  the  case 
where  the  cost  is  a K vector.  For  simplicity  of  presentation,  we  concentrate 
on  the  case  K = 2) . 

Before  defining  optimality,  consider  first  the  case  of  a single  criterion. 
Given  any  u(«)  €m  , sup  J(u(*),v(»))  is  the  guaranteed  upper  value 

v(-)6N(u(-))  * 

of  the  cost  when  control  u(*)  is  used.  A cc.itrol  u (•)  which  gives  the  lowest 

•If 

guaranteed  cost  is  sought,  i.e.,  find  u (•)  satisfying  for  all  u(*)  6 

k 

sup*  J(u  (0,v(.))  £ sup  J(u(-),v(»)) 

v(-)6N(u  (•))  v(.)€N(u(.)) 

A control  satisfying  this  condition  is  called  a minmax  control. 

Now  consider  the  multicriteria  case  when  there  is  no  disturbance.  A 

k 

useful  optimality  criterion  is  Pareto  optimality.  A control  u (•)  is  Pareto 

^f 

optimal  if,  and  only  if,  for  every  u(*)€>l^  either  J^(u(*))  = -^(u  (•)), 
i = 1,2,  or,  for  at  least  one  i€[l,2],  J^(u*(*))<  J^uC*)). 

In  the  following  definition,  we  combine  these  two  concepts  into  a 
definition  of  optimality  which  applies  to  multicriteria  problems  with  dis- 
turbances. 

★ 

Definition  2.1.  A control  u (•)  is  Pareto  optimal  if,  and  only  if,  it  is 


admissible  and  for  all  admissible  u(*)  either 
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sup  J^u  (*),v(*))  = sup  J^uCO.vC*))  ) i = 1,2 

v(.)€N(u*(> ))  v(-)€N(uO)) 

or,  for  at  least  one  i€[l,2}. 


* k 

sup  Ji(u  (*) , v ( • ) ) 

v(-)€N(u*(-)) 


sup  J (u(-) ,v(.)) 

v(.)«=N(u(.)) 


When  the  cost  has  only  one  component  the  problem  is  a two  player  zero- 
sum  differential  game  and  the  definition  becomes  that  of  a minmax  solution 
while,  if  there  is  no  disturbance,  the  definition  is  the  usual  definition  of 


Pareto  optimality.  If  an  admissible  control,  u^('),  is  not  Pareto  optimal, 
then  there  is  another  admissible  control,  u^*),  such  that 


v(*)€N(u2(-)) 


(u2 (* ) »v(*)) 


v(*)^N(u1(.)) 


- 1,2 


with  the  strict  inequality  holding  for  at  least  one  i.  Thus,  if  an  admissible 
control  is  not  Pareto  optimal  there  is  a control  that  reduces  the  guaranteed 
cost  of  at  least  one  of  the  components  of  the  cost  vector  without  increasing 
the  rest. 


Static  versions  of  this  problem  are  treated  in  Ref.  4-6.  In  Ref.  7,  a 
many  player  differential  game  problem  with  coalitions  was  studied  and  that 
problem  can  be  interpreted  as  an  optimal  control  problem  with  disturbances. 
There,  however,  in  deriving  sufficient  conditions,  it  was  assumed  that  a 
related  two-player  zero-sum  game  has  a saddle  point  solution.  We  do  not 
make  that  assumption  here. 
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In  the  next  section  two  sufficient  conditions  for  Pareto  optimal  control 
are  presented.  These  conditions  are  not  directly  working  conditions,  but  only 
a step  in  that  direction.  In  Sec.  4,  we  use  the  second  of  these  conditions 
to  obtain  other  conditions  which  may  be  used  for  determining  Pareto  optimal 
controls. 

3.  Preliminary  Results.  Sufficient  conditions  for  Pareto  optimality 

will  be  obtained  in  terms  of  the  following  two-player  zero-sum  differential 

game. 

J(u(-),v1(-),v2(0)  = Qr^CuCO.VjC*))  + “2J2(u(0  ,v2(*))  (4) 


xx(t)  = f (xx(t)  ,u(t)  .v^t))  , xx(to)  = xc 


(5) 


X (t)  = f(x  (t),u(t),V  (t))  , X (t  ) = X 

Z Z Z Zoo 


(6) 


Here  x^ (t) ,x2 (t)  € Rn,  ( • ) ,v ^ ( • ) € M2  and  admissible  u(-)  are  defined  as  in 

Sec.  2.  One  player  controls  u(*)  while  the  other  controls  v^(*)  and  v2(*). 

Note  that  x^(*)  and  v^(*)  only  enter  J through  while  u(*)  enters  through 

and  J2>  The  time  interval  [tQ,t^]  is  fixed  and  we  require  x^(t^) ,x2(t^)  € 9. 

- * * ★ 

The  controls  Lu  ( • ) , ( * ) J are  a saddle  point  solution  for  this 
game  is  they  satisfy 

^ ^ ^ ^ ^ ^ 

J(u  (•)»v1(*),v2(0)  s J(u  (.),v1(.),v2(0)  * J(u(.),v1(-),v2(.))  (7) 


•jlf 

for  v^(*) ,v9(*)  € N(u  (•))  and  for  all  u(*)  that  are  playable  against  v^(.) 

* 

and  v2(*) . 

In  Theorem  3.1  which  follows,  we  assume  all  u(*)  £ are  playable  against 

(v*(‘),v2(*)). 


f "to  k k 

The orem  3.1.  If  Lu  (•)  ,v^(*)  ,v2(»)3  is  a saddle  point  solution  to  the  dif- 

k 

ferential  game  (4)-(6)  for  some  or^ar^  > 0,  or^  + o^  = 1,  then  u (•)  is  a 
Pareto  optimal  control  for  the  problem  ( 1) - (3) . 

Proof . The  saddle  point  inequalities  (7)  imply 

J(u  (•)  .v^*)  »v2(*))  = sup  J(u  (•)  ,v1(-),v2(*)) 

v1(-),v2(-)€N(u*(.)) 

and  that  for  any  admissible  u(*) 

J(u*(-),v*(.),v*(-))  s (.)) 

vl(*) ,v2(*)^N(u(*)) 

Thus  sup  J(u'V)  .v^*)  ,v2(*) 

vl(') ,v2(’)€N(u  (•)) 

s sup  J(u(-) ,v.(*) ,v  (•)  (8) 

Vl<') »v2 ( ‘ ) €N (u ( ' ) > 

for  all  admissible  u(').  Since  v^(.)  and  x^C*)  only  affect 

2 

sup  J(u(.)  ,v1(*)  ,v2(-))  = I Qf  sup  J (u(*)  ,v.  (.))  (9) 

v1(*),v2(<)€N(u(-))  1=1  Vi(.)^N(u(*)) 

From  (8),  (9)  it  follows  that 

2*2 

“i  sup  J^u  (•),vi(.))  * Z sup  Ji(u(*) ,vi(-) ) (10) 

v1(-)^N(u  (•))  1=1v.(-)£N(u(-)) 

Since  or  ,ar2  > (10)  implies  that  u (•)  is  Pareto  optimal.  □ 

From  this  theorem,  it  is  seen  that  Pareto  optimal  solutions  can  be 
found  by  determining  open  loop  saddle  point  solutions  for  the  two-player 
zero-sum  game  (4)-(6).  As  and  vary,  different  saddle  point  solutions 
may  be  obtained.  Each  of  these  solutions  has  the  Pareto  optimal  property. 
Techniques  for  finding  open  loop  saddle  point  solutions  can  be  found  in 
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Ref.  2,7-10.  Unfortunately,  many  of  the  differential  games  (4)-(6)  which 
arise  from  problems  with  a disturbance  (l)-(3)  do  not  have  saddle  point 
solutions.  They  do,  however,  have  minmax  solutions. 

k 

Definition  3.1.  An  admissible  control  u («)  is  a minmax  solution  to  the  game 
(4)-(6)  if  it  satisfies  for  all  admissible  u(*) 

"k  ys, 

sup  J (u  (•) ,vL(*) ,v2(*))  s sup  J(u(-),v1(*).v2>) 
v^o.vjCoeuw-))  vL(o  ,v2(-)£n(u(*)) 

k 

Theorem  3.2,  If  u (•)  is  a minmax  solution  to  the  game  (4) -(6)  for  some 

k 

a^>a2  > 0,  + a ■?  ~ c^en  u (*)  is  a Pareto  optimal  control  for  the  problem 

(1) - (3) . 

k 

Proof.  Since  u (•)  is  a minmax  solution,  it  satisfies  (8).  The  proof  then 
follows  in  exactly  the  same  manner  as  the  proof  of  Theorem  3.1.  Ij 

Theorems  similar  to  Theorem  3.1  and  Theorem  3.2  were  obtained  for  prob- 
lems involving  coalitions  in  a differential  game  (Ref. 7),  There,  use  was 
made  of  Theorem  3.1  to  find  coalitive  Pareto  optimal  controls.  Here,  we 
shall  concentrate  on  Theorem  3.2  and  use  it,  in  conjunction  with  a sufficient 
condition  for  minmax  control  (Ref.  11)  to  obtain  sufficient  conditions  for 
a Pareto  optimal  solution  to  the  problem  with  disturbances  (l)-(3).  Also  a 
possible  technique  for  determining  Pareto  optimal  solutions  based  on  these 
sufficient  conditions  will  be  discussed. 

4.  Main  Result.  In  Ref . (2, 11) there  are  sufficient  conditions  for  a control 
to  be  a minmax  control.  Based  on  these  results,  as  well  as  Theorem  3.2,  we 
obtain  sufficient  conditions  for  a Pareto  optimal  control  for  the  original 
problem  (l)-(3).  First,  we  need  some  definitions.  For  i = 1,2,  the  set 
^(u(*))  consists  of  the  admissible  disturbances  that  are  playable  against 
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u(*)  amd  maximize  J.. 


£.(u(*))  = Iv(-)  : v(*)^N(u(«) ) and 


Ji(u(«) ,v(-) ) = sup  Ji(u(*),v(’))} 
v(-)^N(u(.)) 


i = 1,2 


n “l  m2 

Let  w(*,*)  be  a function  from  R XR  - R and,  for  u(*)6m,,  q (•)  is 

1 w 


the  function  defined  by  q (t)  = w(x(t),u(t))  where  x(*)  is  the  solution  of 

w 

x(t)  = f (x(t) ,u(t) ,w(x(t) ,u(t) ) ,x(t  ) = x , The  functions  w(*,*)  will  be 

o o 

called  response  functions.  The  set  of  admissible  response  function  is 

to  = [w(. , •)  : q (•)  €n(u(*))  for  all  admissible  u(*)} 
w 

Let  Y be  a positive  integer,  y1(*,-)  €to,  i = l,...,y,  z1(*,*)  €to, 
i = 1,***,Y.  Consider  an  optimal  control  problem  with  cost 

K(u(.) ,yi(* , •) ,zi(- , •) ) 


(11) 


and  state  equations 
.i 


x^(t)  = f[x^(t),u(t),y1(x^(t),u(t))]  , x^(tQ)  = xq  i = 1,***,Y  (12a) 
x^(t)  = f[x*(t) ,u(t) .z^x^t) ,u(t) )]  , x^ (tQ)  = i = !,••*, Y (12b) 


The 


terminal  conditions  are  x^(t^),  x^(t^)  € 0,  i = 1,«*»,Y. 


In  the  following,  we  shall  require  > 0,  a > 0.  Letting  p = 


the  cost  can  be  rewritten  as 
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K(u(0,yi(-,-),zi(-,-)) 


Y i Y i 

2 p.  J (u(*),y  (•,•))  + P 2 p.  J„(u(*),z  (•,•)) 

i=l  1 1 i=l  1 c 


(11') 


We  now  present  a sufficient  condition  for  a control  u (•)  to  be  a min- 
max  control  for  the  problem  (4) -(6)  and  thus,  from  Theorem  3.2,  a Pareto 
optimal  control  for  the  problem  (l)-(3). 

Theorem  4.1.  Let  u (•)  be  admissible.  If  there  exists 

i)  a positive  integer  V 

V 

ii)  scalars  p,.  > 0,  i = 1,***,Y,  X p,.  = 1 and  a scalar  p > 0 

1 i=l  1 

iii)  admissible  response  y^ (•,•)> z* (•,■ ) i = 1,***,Y 

such  that 

a)  (•)  SJC^u  (•)),  v^*(*)  €£2(u*(*)),  i = 

ik  i 1'*’  k ik  i k k 

where  (t)  = y ^ (t) ,u  (t)),  v£  (t)  = z (x*  (t) ,u  (t))  and  x^  (•),  (’) 

are  solutions  of 

x*(t)  = f[x*(t) ,u*(t) ,y1(xj(t) ,u*(t) )]  , xJ(tQ)  = xq  i = 1,***,Y 

x^t)  = f[x*(t)  ,u*(t)  .z^x^Ct)  ,u*(t) )]  , x^ (tQ)  = xq  i = 1,  • • • , Y 

* i i 

b)  u (•)  is  an  optimal  control  for  the  problem  P(Y,P,u.,y  (•,•),  z‘(.,-)) 

k 

then  u (•)  is  a Pareto  optimal  control  for  the  problem  (l)-(3). 

/\  k 

Proof . Consider  any  admissible  u(*).  Since  u (•)  is  a solution  of  the  prob- 
lem P(Y, P , P^.y1 (•,•)) , z1(*,*)),  for  any  u ( • ) ^ 

2 „ / */  v . _ 1 _ * . . i.  . . 


l»/iJl(u  (,)»vl  (‘)}  + p E ^iJ2(u  ( * ) »v2^  * ) ) 

1 1 i=l 

V V 

5 i=lM,iJl(a(’)>qG(’))  + P S g.iJ2<u*(-)  ,pi(-)) 


where 


q*(t)  = yi(x| (t) ,u(t) ) i - !,••*, Y 


pi-(t)  = z^x-Ct)  ,u(t))  i = 
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Since  p > 0,  p>t  > 0 i - 1,***,Y,  either 

J^vAo.vjV))  - ^(uCO.qjCO) 

and 

J2(u*(.),vf(-))  = J2(S(-),p£(*)) 

or 

Jx(u  (.),vj*(«))  < ^(uCO.q^O) 

or 

J2(u*(-),V2*(-))  < J2(G(-),pJ(0  ) 


I.**’,  V 


i = 1, 


•,V 


for  some  i € {!,•••, y} 


for  some  i 6 { 1, • • • , y} 


(13) 


(14) 


(15) 


From  (a) 

•k 

sup  J^u  (•)  ,v(0  )• 
v€N(u  (•)) 

•k 

sup  J2(u  (•)  ,v(0  ) 
v€N (u  ( • ) ) 

Also, 

J1(u(*)  »q^(*) ) 
j2(u(*) >p^(*)  ) 

Using  (16)-(19),  each  of  the  three  cases  (13),  (14),  and  (15)  imply  u (•)  is 
Pareto  optimal. 

5.  Discussion.  For  a given  initial  state  and  time,  one  can  proceed  as  follows 
to  obtain  Pareto  optimal  solutions.  Form  the  two-player  zero-sum  game  (4) -(6). 
For  those  values  of  cr^  and  a 2 with  or^  > 0,  > 0 and  or^  + = 1 for  which 

there  is  an  open  loop  saddle  point  solution,  the  corresponding  u(«)  is, 
according  to  Theorem  3.1,  a Pareto  optimal  solution. 


i* 


= Jx(u  (•),vl  (•))  i = !,*••, Y (16) 


J2(u*(-),v2*(‘) ) 


i = 1» • * * , Y (17) 


s sup  J (u(-),v(*)) 

v(*)£N(u(*))  1 


(18) 


s J2(u(*),v(-)  ) 

v(*)€n(u(*))  1 


(19) 


1] 
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If  there  does  not  exist  a saddle  point  solution,  we  must  resort  to 
Theorem  4.1.  Choose  a real  integer  Y s 2 and  functions  z1  (•,•). 

i = 1,***,Y.  Then  determine  the  optimal  control  for  the  problem 
P(V,P,M..,y1(*>-),zL(-,-))  in  terms  of  p and  p^,  i.e.,  u(* , p,  p^,  • • • , p.  ) . If 
possible,  choose  the  p.^  so  that 

J1(u(0,yi(-,*))  + P J2(u(.),zl(-,-)) 

= J1(u(*),yi(*,0)  + p J2(u(-),zj(-,-)) 

for  all  i,  j£(l,»*',Y}.  For  every  p > 0 for  which  this  can  be  done,  we  then 
have  a candidate  for  a Pareto  optimal  solution  of  the  problem  (l)-(3).  It 
may  then  be  possible  to  verify  that  these  candidates  are  solutions  by  using 
Theorem  4.1.  In  checking  (a)  and  (b) , of  Theorem  4.1,  standard  sufficiency 
results  for  optimal  control,  such  as  Ref.  12-16,  can  be  used.  Of  course, 
choosing  Y,  y1(*,*)  and  zL(«,*)  may  be  difficult  and  some  ingenuity  as  well 
as  trial  and  error  must  be  used. 

The  general  idea  of  the  procedure  is  to  let  or ^ take  on  all  possible 
values  in  the  interval  (0,1).  For  every  value  of  in  this  interval  we 
hope  to  get  a Pareto  optimal  solution.  If  there  is  an  open  loop  saddle 
point  solution  corresponding  to  a particular  or  , we  use  Theorem  3.1;  if  not, 
we  find  a minmax  solution  and  use  Theorem  4.1. 

6.  Example.  Consider  the  following  problem  with  scalar  x(»)»  u(-)  and  v(*). 


Jj^uCOfVC*))  = 

x2(l),  J2(u(*),v(.))  = -x(l) 

(20) 

x(t)  = u(t)v(t) 

w 

X 

o 

w 

1! 

(21) 

U = [u  : U2  S 1} 

, V = [v  : 1 s v S 2} 

(22) 

First  we  form  the  two  player  differential  game  (4) -(6) 


J(u(*),v1(.),v2(-))  = ar^Cl)  - a x2(l) 

x1(t)  = u(t)v1(t)  ; x1(0)  = j 

x2(t)  = u(t)v2(t)  ; x2(0)  = j 

Checking  for  open  loop  saddle  solutions  as  ar^  ranges  between  0 and  1,  we 
find  that  there  are  such  solutions  for  (0,  6/7)  and  that  the  controls 

u(‘),  v^(*)  and  v2(*)  are  constant.  These  results  are  summarized  in  Table  1. 


TABLE  1 

Of 

u(-) 

v1(*) 

v2(*) 

0<“isTl 

1 

2 

1 

— < a £ i 

1 

“ 2*1 

2 

1 

11  1 3 

80^ 

-i-  c a si 

0 

1 “ai 

1 

3 12 

a 

1 

1 . ^ 2 
— < O',  s — 

o 

2(1  - a^) 

2 

2 13 

3 

*1 

\ < O'  s | 

1 

2 al 

1 

2 

3 17 

ar. 

1 

The  inequality  J(u(-)  .v^*)  ,v2(*) ) £ J(u(* ) (• ) ,v2<- ) ) was  verified  via  the 

direct  sufficient  conditions  (Ref.  13,14)  while  the  inequality  J(u(*)  .v^*) , 
v2(*))  s J(u(  • ) ,v^(* ) ,v2  (• ) ) was  established  using  field  type  sufficiency 
theorems  (Ref.  10,11).  That  the  u(*)  part  of  the  saddle  point  solution  is  a 
Pareto  optimal  solution  follows  from  Theorem  3.1. 
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For  6/7  < ar^  < 1,  there  is  no  open  loop  saddle  point  solution  and  we 

must  resot  to  Theorem  4.2.  To  this  end,  we  consider  the  control  problem 

given  by  (11)-(12)  with  Y-2,  yV)  = 1,  y2(0  = 1,  zV)  = 2,  z2(»)  = 2, 

1 2 

0 < p < -,  p^  = 2p  + — and  p<2  = 1 - p.  . 

K(u(*),y1(*),z1(.))  = p.1[x^(l)]2+  p2[x2(1)]2  - pp^x*  - Pp2x2(1) 
xj(t)  = u(t)  , x2(t)  = 2u(t) 

x2(t)  = 2u(t)  , x2(t)  = 2u(t) 

xj(0)  = x2 (0)  = x2 (0)  = x2(0)  = \ 

•k 

Since  u (t)  = -1/3  is  a solution  to  this  optimal  control  problem  and  since 
yi(*)  €£^(u  ('))>  zi(*)  €£2(u  (*))j  i * 1,2,  u (*)  is  a Pareto  optimal 
solution  for  this  problem.  Also,  since  p = a^/or^  anc*  0 < P < 1/6,  this 
solution  corresponds  to  6/7  < < 1.  Note  that  Theorem  3.1  does  not  apply 

when  6/7  < a ^ < 1 since  there  is  no  saddle  point  solution  and  Theorem  4.1 
is  needed. 

6.  Concluding  Remarks 

In  the  definition  of  optimality  in  Sec.  2,  for  a given  u(*)»  the  maxi- 
mization operation  is  over  all  v(-)  that  lead  to  termination  against  u(.). 
This  may  be  considered  unrealistic  since  there  is  no  assurance  that  nature 
will  choose  v(.)  to  terminate  on  6.  For  problems  where  the  differential 
equations  (1)  satisfy  a growth  condition  and  the  terminal  set  9 = Rn,  every 
u(*)  is  playable  with  every  v(*)  € M2  and  this  difficulty  does  not  arise. 

In  the  general  case,  restricting  and  M2  so  that  all  pairs  (u(*),v(*))  with 
u(*)  € and  v(*)  € M2  are  playable,  would  eliminate  the  necessity  of  the 


__ 
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playability  assumption  on  v(.).  If  it  is  felt  that  the  condition  that  the 
maximization  operation  is  over  all  v(.)  that  lead  to  termination  is  unrealistic, 
then  the  theory  should  be  applied  only  to  problems  where  and  M2  are  such 
that  all  pairs  (u(-),v(-))  with  u(.)  6 Mx  and  v(.)  €m2  are  playable. 
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1.  INTRODUCTION 

In  this  paper  we  present  a simple  derivation  of  necessary  conditions  for 
static  minmax  problems.  The  problem  is  to  choose  x £ XC  Rn  to  minimize 

f(x)  = sup  0(x,y)  (1) 

y 6 Y 

where  0(*,*)  : Rn  x Rm  — R is  C^.  Y is  a specified  subset  of  Rm  and  X = {x]c(x)  S 0] 
The  function  C(*)  : Rn-*  RP  is  on  Rn. 

Necessary  conditions  which  the  minimizing  point  must  satisfy  are  given  in 
[l-3]  in  terms  of  the  directional  derivative  of  f(*)*  This  results  in  a 
Lagrange  multiplier  rule  which  is  an  inequality.  In  [4],  the  necessary  con- 
ditions are  in  the  form  of  a Lagrange  multiplier  rule  that  is  an  equality. 

Here,  we  derive  the  results  of  [4]  in  an  alternate  and  simpler  fashion. 

Our  approach  is  to  replace  the  above  minmax  problem,  as  suggested  in  [5], 
by  a related  nonlinear  programming  problem  where  the  subsidiary  conditions 
consist  of  an  infinite  number  of  inequalities.  The  resulting  programming 
problem  is  called  the  Fritz  John  problem  [6,7],  A relationship  between  the 
solution  of  the  Fritz  John  problem  and  the  minmax  problem  is  presented.  This 
relationship,  in  conjunction  with  the  necessary  conditions  for  the  Fritz  John 
problem,  lead  directly  to  necessary  conditions  for  the  minmax  problem  which 
are  identical  to  those  in  [4j. 

We  shall  assume  that  Y is  compact.  Then  for  every  x£x  there  exists  a 

y€Y  with  the  property  that  0(x,y)  = sup  0 (x,y)  and  we  can  replace  "sup"  by 

y € Y 

"max".  The  vector  of  partial  derivatives  d0(x,y)/9x  will  be  denoted  by 


0 (x,y).  Similarly,  C.  (x)  = dC.(x)/dx. 


2 


2.  A NONLINEAR  PROGRAMMING  PROBLEM 


As  suggested  in  [5],  we  consider  the  problem  choosing  z 6 Rn+^  to  minimize 


Uz) ' 


m 


subject  to 

* ° , i-l,2,...,p  (3) 

and 

0(zi»z2»,,*»zn>y>  ■ zn+i  5 0 for  a11  y?Y  w 

The  relationship  between  the  solution  of  this  problem  and  the  minmax 

problem  is  given  by  the  following  propositions. 

PROPOSITION  1.  If  z°  is  a solution  to  the  problem  (2)- (4),  then 
o r o o OnT. 

x = [_z^  ,z^,  • • • >znJ  is  a solution  to  the  minmax  problem. 

Proof.  Suppose  x°  is  not  a solution  to  the  minmax  problem.  Then  there 
exists  an  x satisfying 


Ci(x)  0 , i = 1,2,  • • • ,p 


such  that 


sup  0 (x,y)  < sup  0(x°,y)  S z 


y € Y 


y € Y 


n+1 


Let  z . = sup  0(x,y)  and  zT  = [xT  z ].  Then 

n+1  y € Y n+1 


z , < z , 
n+1  n+1 


ci<V--V‘° 


i = 1,2  , • • • ,p 


0(z1,***,zn,y)  - zn+1  ^ o for  all  y6Y 


which  contradicts  the  hypothesis  that  z°  is  a solution  to  the  problem  (2)- (4).  □ 


- JL 
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* * * 
PROPOSITION  2.  If  x is  a solution  to  the  minmax  problem  and  2n+^  = sup  0 (x  ,y), 

*T  _ * - ' y 6 Y 

then  z = Lx  zn+i-l  *-s  a solution  to  the  problem  (2)- (4). 

* 

Proof.  Suppose  z is  not  a solution  to  the  problem  (2)-(4).  Then  there 
exists  a z such  that 

"n+1  < Cl  = SUP 

y € Y 

c(zi,*“,V  5 0 


0(z1>***  .z^.y)  - zn+1  <;  0 for  all  y€Y 


The  last  inequality  is  equivalent  to 


sup  0(z  ...,zn,y)  S z 

y € Y 


Then  (5)  and  (6)  imply 


sup  0(z  ...,z  ,y)  < sup  0 ( x ,y) 

y€Y  y€Y 

"ft 

which  contradicts  the  hypothesis  that  x is  a solution  to  the  minmax  problem.  I 

Thus,  the  minmax  problem  is  equivalent  to  a Fritz  John  problem.  In  the 
next  section,  we  state  the  necessary  conditions  for  the  Fritz  John  problem. 

Then  we  apply  the  conditions  to  the  problem  (4)-(6)  and  thereby  obtain  necessary 
conditions  which  the  minmax  solution  must  satisfy. 

3.  NECESSARY  CONDITIONS  FOR  A MINMAX  SOLUTION 
The  Fritz  John  problem  we  are  interested  in  is  to  determine  z S Rn+^  which 
minimizes 


subject  to 


Ci(z)  s 0 i * 1,2, • . . ,p 


and 


9(z,y)  s 0 for  all  y€Y 


where  ©(•,•)  : Rn+^  x Rm-»  R is  a C^"  function.  Necessary  conditions  which  a 
minimizing  point  must  satisfy  are  given  in  [6]  or  [7], 

k 

THEOREM  1.  Let  z be  a minimizing  point.  Then  there  exists  an  integer  a, 

scalars  \ s 0,  \,  > 0, • • • ,X  >0,  scalars  u,.  s 0 i = l,-**,p  and  vectors 
o i or  i 

1c 

y g f y | 9 ( z , v ) =0^,  k=  1 , « • • ,cy  such  that 


* o'  * t P * 

X L (z  ) + I \ 0 (z  ,y  ) + £ n.C  (z  ) = 0 

O Z i=l  1 z i=l  1 12 


J 


P-C^z  ) = 0 i = 1,2,...  ,p 
Q(z*,y)  £ 0 for  y 6 Y 

Furthermore,  if  3 is  the  number  of  nonzero  p,^,  lfior+P^n  + l. 

Applying  this  theorem  to  the  problem  (2)- (4)  leads  to  the  conditions 

£ (z*,  * * • jZ^.y1)  + £ v.C  2.<V*"’Zn>  = 0 1 

i=l  j i=l  j 

a 

X - £ X.  = 0 

° i=l  1 

^ici(z*,...,z*)  = ° i = 1 > * * * >P 
0(z*,...  ,z*,y)  - z*+1  S 0 for  all  y€Y 

where  each  y1  satisfies 

k k x k 

0(z1,.*.,zn,y  ) - zn+1  = 0 for  all  y€Y 

Restating  these  results  in  terms  of  x rather  than  z results  in  necessary  con- 
ditions for  the  minmax  problem  which  are  identical  to  those  in  [4],  Specifically 
we  have 


) - 0 , i = l,2,««»,p  , 


Furthermore,  if  8 is  the  number  of  nonzero  u . , 1 s tt  + 3 S n + 1, 
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